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Symposium on the Use of Projective Techniques as Research Tools 
in Studies of Normal Personality Development’ 


Observations on the Use of Projective Techniques in 
Child Development Research 


VAUGHN J. CRANDALL 
Fels Research Institute for the Study of Human Development 


While most projective tests were 
originally developed and used in ap- 
lied clinical settings, these techniques 
fait become an increasingly impor- 
tant and integral part of personality 
research as well. This has been es- 
pecially true of research concerned 
with normal personality development, 
the topic of the present symposium, 
The participants of this symposium 
are members of various child develop- 
ment research centers, with the writer 
representing the Fels Research Insti- 
tute for the Study of Human Devel- 
opment.” It is not the purpose of this 
symposium to discuss all research em- 
anating from these centers using pro- 
jective techniques as research tools. 
Detailed reports of these studies have 
appeared in various journals. Rather, 
the papers of this symposium will at- 
tempt to evaluate the general appli- 
cability of projective ye in 
child development research. The pres- 





* This and the four following papers are 
abridged versions of papers read as part 
of a symposium on projective techniques 
as research tools in studies of normal per- 
sonality development sponsored by the 
Society for Projective Techniques and Di- 
vision 12 of the American Psychological 
Association at the American Psychological 
Association meeting in San _ Francisco, 
September, 1955. Moderator: L. Joseph 
Stone. 

* The Fels Study, originating in 1929, is a 
continuous longitudinal, multi-disciplin- 
ary research project concerned with the 
development of normal children. The 
sample, at any given time, is comprised 
of + apron se 180 children from 125 
middle-class families. Original application 
for admission to the Study is made by 
mothers during pregnancy. From the time 
of admission until the child’s eighteenth 
birthday, the father, mother and child 
are members of the Study, with longitud- 
inal and experimental data being obtained 
from each by the Fels Departments of 
Psychology, Biochemistry, Physical Growth 
and Psychophysiology. 


ent paper will be concerned with sev- 
eral methodological problems intrin- 
sic to the use of projective tests in this 
area, and with some of the advantages 
and limitations of various projective 
media as research tools in current and 
future child development research. 


One problem inherent in, though 
not unique to, the use of projective 
techniques in personality develop- 
ment research is that of the categori- 
zation of responses. Since projective 
techniques are designed to elicit rela- 
tively “free”, unstructured responses, 
these responses must be subsequently 
categorized by the researcher in some 
fashion. Often in past research, pro- 
jective test responses have been an- 
alyzed according to a hodge-podge of 
empirically-derived, and atheoretical 
categories. “Sign approach” methods 
for analyzing Rorschach protocols 
exemplify this approach. Such em- 
‘ager Dgpestins systems can seldom 

e used to categorize responses evoked 
by techniques other than those for 
which they were originally devised 
and, as a result, data analyzed in such 
a manner often lack generality. These 
data can neither be directly compared 
with data gathered by other person- 
ality assessment methods, nor can 
they be readily related to existing per- 
sonality theories. In the light of these 
limitations, it is incumbent on future 
personality development research to 
develop theory-oriented systems of 
categorizations applicable to data elic- 
ited by a variety of personality assess- 
ment methods. Ideally, such systems 
of categorization should be equally 
suitable for objective, subjective and 
projective responses whenever pos- 
sible. Examples of existing methods 
of analysis which may conceivably be 
used in this fashion are Raimy’s 
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PNAv method developed within the 
framework of self-concept theory 
(10), Dollard and Mowrer’s Discom- 
fort-Relief Quotient influenced by 
Hullian learning theory (7), and the 
writer’s Social Reinforcement Index 
developed within the context of So- 
cial Learning Theory (5). 

A second general problem of per- 
sonality development research arises 
from the fact that the responses of 
research subjects are obviously in- 
extricably bound to, and determined 
by, the assessment methods employed. 
This has mixed blessings for person- 
ality development research, On the 
negative side, it strongly limits the 
scope of generalizations which can be 
made from personality research find- 
ings until more is known concerning 
the comparability of data obtained 
with various assessment techniques. 

In the area of child development 
research, for example, a large number 
of studies have investigated various 
aspects of maternal behavior as det- 
erminants of children’s personality de- 
velopment. Almost all of these in- 
vestigations have relied on subjective 
reports of mothers concerning their 
maternal behavior practices. Assess- 
ment methods used to elicit these re- 
ports have included interviews, ques- 
tionaires and self-rating scales. These 
studies were based on the implicit as- 
sumption that mothers’ reports of 
their maternal behavior were reason- 
ably representative of their actual in- 
teractions with their children. No re- 
search, however, has attempted to 
evaluate the degree of correspondence 
between mothers’ reports and their 
actual maternal behavior. We recent- 
ly conducted a study with our Fels 
mothers addressed to this problem (6). 
The mothers were required to rate 
various aspects of their maternal be- 
havior using twenty-four self-rating 
scales. These scales were specially con- 
structed to parallel twenty-four of the 
Fels Parent Behavior Rating scales. 
The latter scales were used by a Fels 
Home Visitor, an experienced clinical 
psychologist, to rate the mothers’ overt 
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maternal behavior as observed in the 
Fels Home Visit Program. When the 
two sets of ratings were compared, 
they were, in general, positively re- 
lated. However, in none of the twenty- 
four correlations was as much as half 
of the variance held in common. Self- 
reported maternal behavior was clear- 
ly not the same as observed maternal 
behavior. While these results are not 
particularly surprising, they illustrate 
the fact that data gathered by differ- 
ent assessment techniques may be far 
from comparable, especially when 
these data are based on different lev- 
els of expression—objective, subjec- 
tive or projective. The results of such 
a study add a note of caution for ma- 
ternal behavior research in general. 
Until more research has been done 
on the comparability of data obtained 
by various methods, the lack of 
knowledge in this area places obvious 
limitations on the scope of theoreti- 
cal generalizations which can be made 
on the basis of present maternal be- 
havior research findings. 

On the positive side, the lack of 
congruence between data collected by 
different assessment techniques may 
provide the possibility of increased 
accuracy of prediction through the 
combined use of objective, subjective 
and projective behavioral informa- 
tion, The ultimate success of such 
personality development research is, 
however, contingent on the caliber of 
personality assessment methods at our 
disposal. In sheer number, there is no 
shortage of potential techniques. The 
last ten years have witnessed a vast 
proliferation of assessment methods, 
particularly projective tests. Unfor- 
tunately, many of these have little 
demonstrated validity or reliability 
beyond testimonials from their au- 
thors. Others, originally developed for 
clinical application, have been proved 
diagnostically useful, but still await 
evaluation as research tools with nor- 
mal children and adults. 

Several questions must be answered 
regarding the utility of an assess- 
ment method for normal personality 
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development research. These include, 
among others, the following: (a) Does 
the technique elicit behavior relevant 
to the problem under investigation 
from all ages of children studied? 
(b) At what level of expression is this 
behavior elicited? (c) Is there an ade- 
quate sampling of this behavior to 
insure stability of measurement? (d) 
Is the range of this behavior sufficient 
to allow inter-subject and intra-sub- 
ject variability? At the moment, few 
of these questions can be answered 
in respect to existing methods of per- 
sonality assessment. As a result, the 
choice of assessment techniques in 
personality development research 
must often be based on intuitive 
hunches and/or haphazard trial-and- 
error. The progress of future person- 
ality development research could be 
greatly facilitated if what might be 
called cartographic studies of exist- 
ing personality assessment methods 
were included in this research. These 
investigations could systematically 
map out the areas, levels and fre- 
quencies of behavior elicited from 
children of various ages by each of 
these techniques. Such information 
would be useful, not only to evaluate 
the techniques as potential research 
tools, but also to delineate areas where 
new methods must be devised. 
Cartographic information of this 
nature should ultimately open new 
avenues of research, Longitudinal in- 
vestigations of the covariation of chil- 
dren’s objective, subjective and pro- 
jective behavior should be possible 
when assessment techniques covering 
comparable areas of behavior at each 
of these three levels of expression are 
available. Such studies could be ad- 
dressed to a variety of personality de- 
velopment problems. For example, 
while a number of studies have been 
conducted on the acquisition of social 
needs in children, there has been lit- 
tle research concerned with changes 
in levels of expression of these needs 
as children mature. Obviously, such 
changes are an important part of 
children’s socialization and personal- 
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ity development. A_ child learns, 
through his social experiences, that 
the overt expression of certain needs 
is socially acceptable while the overt 
expression of other needs is not. 
Studies of adult subjects have dem- 
onstrated that correlations between 
objective and projective expressions 
of socially acceptable needs differ 
predictively from those of socially 
unacceptable needs. In the future, it 
should be possible to study changes 
of such correlations in children’s be- 
havior with age, as well as factors 
producing these changes. Similar 
kinds of investigations should be feas- 
ible in respect to the development of 
ego defenses in normal children. 

There is one trend in current child 
development research which should 
radically affect the future role of pro- 
jective techniques as research tools 
in this area. As Radke-Yarrow and 
Yarrow noted in last year’s Annual 
Review of Psychology (9), studies of 
children’s behavior testing specific 
hypotheses derived from systematic 
personality theories are rapidly in- 
creasing. In these kinds of investiga- 
tions, the hypotheses of a study rig- 
idly determine the nature of behavior 
to be measured and, thus, dictate the 
requisite characteristics of techniques 
which may be employed to elicit this 
behavior. It is unlikely that stand- 
ard projective techniques can be used 
in much of this research. More often, 
studies of this nature will require 
either the modification of existing 
techniques or the development of 
new ones. 

There are, fortunately, several pro- 
jective media which can be readily 
adapted to meet theory-oriented re- 
search needs. One of these is TAT- 
like pictures. Specially-constructed 
sets of pictures can be developed to 
test a variety of theoretical hypoth- 
eses. Examples of this are Blum’s use 
of the Blacky pictures to test psy- 
choanalytic hypotheses (1), some of 
the studies of McClelland, et al, on 
need achievement (8) and our own 
use of specially-constructed pictures 
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to test hypotheses derived from Social 
Learning Theory (2, 3, 11). Incom- 
plete stories and sentences are also 
particularly adaptable for theory-ori- 
ented personality studies of children; 
sets of either of these can be readily 
constructed to elicit behavior rele- 
vant to a variety of specific hypoth- 
eses, Semi-structured imaginative play 
situations can also be used with chil- 
dren in a similar fashion. 


On certain occasions, future theo- 
retically-oriented personality studies 
may be able to employ existing pro- 
jective materials as they are, but will 
require subjects to use these mate- 
rials in new ways. For example, we 
are currently conducting a norma- 
tive, cross-sectional study of children’s 
social perceptions and expectations 
using MAPS figures as stimuli. The 
standard procedure for administering 
the MAPS figures is not used. Rather, 
each child is presented selected groups 
of MAPS figures and is told to sort 
them according to whether they rep- 
resent people he would like or dis- 
like. The child is also encouraged to 
discuss the basis of his decisions. This 
method elicits material from each 
child in respect to the specific per- 
sonality characteristics he imputes to 
the various figures and the cues upon 
which these projections are based, 
while eliminating the imaginative 
story-telling aspects of the MAPS pro- 
cedure. Preliminary use of this tech- 
nique suggests that it is a reasonably 
effective one for eliciting children’s 
responses indicative of their inter- 
personal perceptions and _ expecta- 
tions. An interesting variation of this 
method is the use of actual persons 
as projective stimuli. We have recent- 
ly found this variation useful with 
college students (4), but have not, as 
yet, tried it with children. 

Finally, there is one projective me- 
dium, used sparingly in the past, 
which appears to be a particularly 
promising one for future theory-ori- 
ented research on normal personal- 
ity development. These are motion 
pictures. In the last five years or so, a 
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sizable number of documentary psy- 
chological films have been produced. 
Some of these films have dealt with 
various stages of personality develop- 
ment. Others have portrayed specific 
types of inter-personal relationships 
among children and between children 
and adults. Still others have focused 
on particular aspects of personality 
dynamics. Many of these films may be 
suitable for specific research prob- 
lems. For example, existing films on 
parent-child relationships could be 
used in research on parental behavior 
to elicit projective responses of moth- 
ers and fathers revealing their par- 
ental attitudes, aspirations and expec- 
tations. Other available films could 
be employed to study age differences 
in children’s social perceptions and 
expectations as reflected in their de- 
scriptions of the motives and _per- 
sonality characteristics of characters 
in the film stories. 

To summarize, while projective 
techniques will undoubtedly play an 
important role in future studies of 
normal personality development, 
their exact contribution cannot be 
predicted. It seems likely that stand- 
ard projective tests will be employed 
less frequently than in the past. While 
these techniques will, of course, con- 
tinue to be used in normative studies 
of children’s projective behavior per 
se, they will probably not be an im- 
portant part of future theory-orient- 
ed personality development research. 
The contribution of existing projec- 
tive techniques in this latter research 
will depend, in part, on future dem- 
onstrations of their utility as research 
tools through special validation and 
cartographic studies, Their ultimate 
contribution will largely rest on the 
imagination and ingenuity with 
which these techniques can be modi- 
fied, and new ones developed, to meet 
the ever-changing needs of future re- 
search. 
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Use of the Rorschach Test in Longitudinal Studies 
of Personality Development * 


Henry N. RiccivuTi 
The Child Research Council and the University of Colorado School of Medicine 


In the present paper, I propose to 
discuss some of the ways in which 
one specific projective technique, the 
Rorschach Test, can be used fruit- 
fully in longitudinal studies of per- 
sonality development such as _ those 
being carried on at the Child Re- 
search Council in Denver. I shail 
make no attempt to present any for- 
mal, systematic summary of our Ror- 
schach results on particular problems; 
rather, I shall discuss briefly some of 
the potential research advantages af- 
forded by Rorschach material collect- 
ed longitudinally on _ intensively 
studied individuals, as well as some 
of the theoretical and methodological 
questions and difficulties which arise 
in such an approach. In the course of 
this discussion, I shall refer infor- 
mally to some of our own Rorschach 
findings. 

By way of background information, 
perhaps it would be helpful to say a 
few words about our psychological 
studies, which represent one part of 
the Child Research Council’s pro- 
gram of research on physical, physi- 
ological, and psychological growth. 
Essentially, our research is concerned 
with the intensive longitudinal study 
of a relatively small number of “nor- 
mal” individuals, who are seen from 
birth onwards, as often as once a 
month during the first year, and with 
gradually decreasing frequency as the 
child gets older. The major long- 
range objective of our investigations 
is the elaboration and _ validation, 





1 Grateful acknowledgment is made to Dr. 
John D. Benjamin, director of the psycho- 
logical studies at the Child Research Coun- 
cil, for his assistance in the preparation of 
this paper. Research supported in part by 
grants from the Field Foundation, Com- 
monwealth Fund, and Scottish Rites Re- 
search Committee. 


through prediction studies, of various 
hypotheses stemming from the psycho- 
analytic theory of personality develop- 
ment. Among the techniques we use 
are observations of mother and child 
during infancy, combined with de- 
velopmental testing during this pe- 
riod, periodic intelligence testing, 
play interviews, interviews with par- 
ents, observations of the child at 
home, and a variety of projective 
techniques, including the Rorschach 
and TAT. At the present time, Ror- 
schach testing is begun at about age 
two, or shortly thereafter, and it is 
repeated about once a year, unless 
more frequent testing seems indicat- 
ed in a particular case. 


It is‘our feeling that repeated ad- 
ministration of the Rorschach in 
longitudinal studies offers a dual sci- 
entific advantage. In the first place, 
we feel that the Rorschach is of great 
help in evaluating developmental 
changes in various aspects of the 
child’s personality, and hence it will 
enhance our understanding of devel- 
opmental processes. Second, we are 
convinced that the collection of Ror- 
schach protocols on intensively 
studied individuals provides a valu- 
able opportunity for systematic study 
of the validity of a variety of Ror- 
schach inferences. Implicit in the 
above statements is the belief that 
both the Rorschach Test and our 
understanding of personality develop- 
ment will profit when there is an op- 
portunity to study them both simul- 
taneously. 


For purposes of conceptualization, 
let me sketch briefly three types of 
situations which might obtain when 
a psychological test is utilized in de- 
velopmental studies. 1) If perform- 
ance on a test of unknown or un- 
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demonstrated validity is found to 
parallel closely well established de- 
velopmental changes, this would pro- 
vide strong evidence that the test is a 
valid measure of the processes under- 
going change. In some respects this 
was the sort of situation which char- 
acterized Binet’s development and 
validation of his intelligence scale. 
2) When a test is known to have high 
validity and _ reliability for the 
measurement of a particular psycho- 
logical function, then its administra- 
tion to children in developmental 
studies would provide us with highly 
accurate information about age 
changes in the process under study. 
A good test for measuring growth of 
children’s vocabulary would be an 
illustration here. 3) I would like to 
suggest that, for the most part, when 
we use projective techniques in the 
study of personality development, 
neither of the two situations just 
mentioned applies. Rather, we com- 
monly find ourselves in a position 
where our theory of developmental 
changes may be reasonably convinc- 
ing but in need of a great deal of 
elaboration and verification, while 
much the same thing can be said 
about the rationale and validity of 
our projective techniques. In such 
instances, we look for some sort of 
congruence between projective test 
results and the changes postulated by 
developmental theory, or between pro- 
jective test results and observed de- 
velopmental changes. When we find 
such congruence, the validity and 
rationale of the projective technique, 
as well as the developmental theory 
are given added support. When such 
congruence is not found, then one 
has to decide in each case whether to 
question the validity of the projective 
test or the developmental theory, or 
both. 


Let me give you an illustration of 
a study (2) where the degree of con- 
gruence found between projective 
test results and developmental theory 
may be interpreted as lending con- 
siderable support to the validity of 
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both. Some time ago, Dr. Benjamin 
became interested in using the Ror- 
schach to follow the course of anxiety 
in a small group of children from the 
age of about 314 to puberty. As a 
rough quantitative estimate of the 
amount of anxiety present at any 
given time in the Rorschach record, 
he used seven signs which were 
weighted differentially, on the basis 
of his clinical experience with chil- 
dren and adults. The validity of this 
particular combination and weight- 
ing of signs, of course, was not 
known. 

When the course of anxiety, thus 
measured, was followed longitudin- 
ally for a small group of boys and 
girls, although there were some 
marked differences in the graphs for 
various children, the common trend 
for the group of children was of 
great interest. In general there was 
an anxiety peak between four and 
five years, then a descent and leveling 
off, followed by a gradual or sudden 
ascent just before puberty. The cor- 
respondence between these age 
changes in anxiety as measured by 
the Rorschach, and the pattern of 
psychosexual development from the 
preschool period to adolescence as de- 
picted by psychoanalytic theory, is 
) oon clear. Since there is good evi- 

ence that there is a close connection 
between at least some anxieties and 
sexuality, we do not believe it would 
be going too far to state that the con- 
gruence found between changes in 
anxiety level and the psychoanalytic 
theory of changes in sexuality during 
this period, can be interpreted as 
lending some support both to the 
validity of the Rorschach measure- 
ments of anxiety and to the psycho- 
analytic theory of psychosexual devel- 
opment. 


Now suppose that the anxiety 
changes were —— disparate 
with what one might expect on the 
basis of psychoanalytic theory. To 
reconcile these findings one would 
want to re-examine either the ra- 
tionale of the anxiety measures or 
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the developmental theory, depending 
upon which was regarded as the 
weaker link in the chain. In most in- 
stances however, one would probably 
want to re-evaluate both the test the- 
ory and the developmental theory in 
the hope of explaining the lack of 
relationship. This would normally 
lead to revised formulations and new 
investigations which would contrib- 
ute to our understanding and use of 
the projective technique, as well as 
to our developmental theory.” 
There are many specific problems 
which could be fruitfully investigated 
with the Rorschach in longitudinal 
studies of personality development. 
By way of illustration, let me de- 
scribe very briefly just a few of these 
which happen to be of particular in- 
terest to us, A second part of the 
study iust described was concerned 
with difterentiating between  free- 
floating and phobic anxiety, again 
based primarily upon clinical expe- 
rience with adults, and the use of 
this differentiation in following long- 
itudinallv, sex differences in the devel- 
opmental vicissitudes of early phobic 
fears. There seem to be considerable 
grounds for believing that we can go 
further and reliably differentiate two 
tvpes of phobic anxiety: first, a series 
of fundamental fears such as fear of 
the dark, fear of separation from 
mother, fear of death, etc.. which, as 
suggested by Benjamin and in some- 
what different form by Oberholzer 
(8), may be inferred from the pres- 
ence of black shock, especially on 
card IV, when this black shock can 
be differentiated from shading shock. 
The second group of anxieties con- 
sists of fear of bodily injury, or mu- 
tilation and castration fears, which 
Benjamin found were reflected by red 
shock on cards II and/or III, or by 
blood and fire responses to cards II 
or III in the presence of color shock 





? Some of the methodological concepts con- 
cerning validity which are involved here 
are discussed systematically in Cronbach 
and Meehl’s recent paper on “construct 
validity” (3). 
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on cards VIII, IX, and X. The possi- 
bilities for evaluating the validity of 
these Rorschach interpretations of 
anxiety on children who are being 
intensively studied longitudinally are 
quite obvious, and very challenging. 

From the standpoint of elaborating 
and clarifying Rorschach rationale, 
the great importance of research on 
age changes in all Rorschach loca- 
tion, determinant, and content cate- 
gories is self-evident. The increased 
interest in such problems, as attested 
to by the number of recent studies in 
this area, both longitudinal and cross- 
sectional, (e.g. 1, 7), is indeed en- 
couraging. In longitudinal studies, 
one has the opportunity to relate 
changes in Rorschach scoring cate- 
gories for individual children, to 
knowledge about personality changes 
derived from other sources. Studies of 
this type should assist us greatly in 
identifying some of the psychological 
processes or characteristics reflected 
in various Rorschach scoring cate- 
gories. At the same time, they present 
a particularly good setting in which 
to evaluate the reliability of various 
Rorschach response characteristics. In 
investigating the reliability of any 
personality test, it is not enough sim- 
ply to examine the extent to which 
the test yields similar results upon 
retesting. One also needs to know 
whether the underlying traits or 
functions being measured have re- 
mained stable or are changing. Long- 
itudinal investigations of Rorschach 
response changes as related to inde- 
pendently observed changes in the in- 
dividual should help us evaluate the 
reliability of the various scoring cate- 
gories, some of which can be expected 
to be considerably more reliable than 
others (e.g., 6, 10). 

It is felt by many that the most 
convincing evidence for both the use- 
fulness and validity of the Rorschach 
technique is found in the area of 
multiple-sign interpretation for pur- 
poses of clinical diagnosis in adults. 
In view of the established clinical 
value of the Rorschach with adults, 
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it would be of great theoretical and 
practical value to identify and follow 
from an early age Rorschach mani- 
festations of the onset and develop- 
ment of psychopathological processes, 
Such research would contribute both 
to our understanding of the develop- 
ment of psychopathology, and to the 
validation of the Rorschach, 


The research questions which we 
have discussed thus far involve the 
use of the Rorschach primarily as a 
technique for the assessment and de- 
scription of personality. The Ror- 
schach may also be used primarily as 
an experimental task, especially for 
the study of perceptual processes. The 
work of Werner and his associates at 
Clark University (4, 5), as well as 
other studies in which principal in- 
terest is centered on the way in which 
the blot or blot parts are organized, 
particularly in chihinen and _schizo- 
phrenics, illustrate this experimental 
use of the Rorschach, in which in- 
terpretation as such plays a minor 
role. Another experimental applica- 
tion of the Rorschach which would 
seem to have particular promise in 
longitudinal studies is the structure 
and use of the inquiry for studying 
the development of thinking pro- 
cesses, in close analogy to Rapaport’s 
use of the inquiry for studying think- 
ing in schizophrenics (9). 

Let us next consider several the- 
oretical and methodological problems 
which arise when the Rorschach is 
utilized in developmental studies, par- 
ticularly of the longitudinal sort. 
There is first of all the problem of 
frequent repetition of the test over a 
long period of time, and the effect 
this may have upon Rorschach re- 
sponses and their significance. We are 
faced with a dilemma here: one wants 
to administer the test often enough 
to detect significant changes in per- 
sonality functioning, but at the same 
time not so often as to render the test 
somewhat less effective in known or 
unknown ways because of too fre- 
quent repetition. Actually, the effect 
of repeated testing is a very critical 
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problem in all longitudinal studies, 
since one needs to know to what ex- 
tent change or lack of change in test 
response reflect the state of the un- 
derlying process or trait being evalu- 
ated, and to what extent they repre- 
sent same artifact due to repetition of 
the test. 

Another problem of both theoreti- 
cal and methodological importance is 
the fact that when identical test tasks 
are presented to children at different 
ages and yield results that seem to 
differ only quantitatively or in level 
of performance, one needs to examine 
the possibility that there may also be 
— age changes in the psy- 
chological processes which are in- 
volved in test performance, Putting it 
simply, the problem is that the same 
test may not measure the same thing 
at different ages. For example, form- 
board performance at age four or five 
might reflect differences in spatial 
perception primarily, while the same 
formboard given to older children 
would probably involve principally 
individual differences in psychomotor 
— Consequently, a growth curve 
showing age changes in formboard 
performance would not represent a 
single psychological function but sev- 
eral functions, each of which may 
have quite different patterns of 
growth. In developmental Rorschach 
studies it is quite obvious, for ex- 
ample, that W % in adults represents 
something qualitatively quite differ- 
ent from % in children, so that 
mere plotting of W % against age 
without an examination of qualita- 
tive differences in the underlying pro- 
cesses would be relatively meaning- 
less. Similarly, we need to know 
whether the psychological implica- 
tions of shading responses, movement 
responses, color responses, etc., are 
the same for children at different ages 
and for adults. 

In this paper I have tried to em- 
phasize our conviction that the use of 
the Rorschach technique in _ longi- 
tudinal studies of personality develop- 
ment presents the opportunity for in- 
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vestigating many significant research 
questions, while at the same time it 
raises some important theoretical and 
methodological problems. I have tried 
to stress the belief that studies of this 
sort can make important contribu- 
tions both to the theory and valida- 
tion of the Rorschach Test, as well 
as to the elaboration and verification 
of developmental theory, particularly 
if emphasis is placed upon under- 
standing the psychological processes 
involved in Rorschach test perform- 
ance. 
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The Predictive Potential of Projective Tests for 
Nonclinical Populations 


IrvING E. SIGEL AND MARTIN L. HOFFMAN 
Merrill-Palmer School * 


Projective tests are often used to 
assess personality dynamics in order 
to predict the functioning of the re- 
spondent in real life situations. Suc- 
cess in making such predictions has 
been limited. It is our aim in this 
paper to present an approach in 
which this problem has been han- 
dled in the context of studying par- 
ent-child interactions and_ relation- 
ships, with interesting and suggestive 
results. 

At least two reasons can be ad- 
vanced for the limited success of pro- 
jective tests in prediction, especially 
with unde populations. The 
first reason revolves around the rela- 
tionship existent between personality 
and environmental variables as they 
interact within a context of real life 
situations; the second pertains to the 
content of the projective test itself 
and its relation to the real life situ- 
ations in question. 

Our assumption is that the normal 
individual’s overt behavior is an ex- 
pression of his personality structure 
in conjunction with the demands of 
the immediate environment. Being 
normal, the individual is sufficiently 
flexible and integrated, to make a 
variety of responses which are ap- 
propriate to the requirements of the 
situation. Consequently, in order to 
enhance prediction, it is important 
to denote the parameters of the real 
life situation. It becomes important 
to define and specify the types of en- 





* The research project out of which ' this 
paper was developed is entitled, “A Study 
of Parent Influences Used in Controlling 
Child Behavior and their Psychological 
Effects on the Child,” and was begun with 
funds granted by the Social Research 
Foundation in 1952. The project is cur- 
rently financed by a grant from the 
Foundations’ Fund for Research in Psychi- 
atry. 


vironmental situations and conditions 
which one is predicting. 

In the exploratory study to be re- 
ported, we conceptualized in detail 
the environmental aspects of the spe- 
cific situation toward which we were 
predicting. In this case, we predicted 
parent behaviors which were used in 
attempts to modify the behavior of 
the child.? 

In addition to such conceptualiza- 
tion of the pertinent social environ- 
ment, the particular type of projec- 
tive test employed is of considerable 
importance in enhancing predictive 
success. We’ reasoned that since the 
parental behavior we wished to pre- 
dict took place in the context of in- 
teraction with the child, we should 
use a projective test which would 
elicit those features of the parent per- 
sonality which manifest themselves 
in such interactions. At the same time 
it was apparent that too much struc- 
ture might result in a great corres- 
pondence between test response and 
predicted behavior. This could de- 
stroy the projective nature of the test. 
Therefore, our projective test was 
made up of parent and child figures 
in unstructured situations. As the 
parent revealed himself in this con- 
text, we reasoned, he would offer us 
a relevant set of data upon which to 
predict his behavior in the real life 
situation. He would indicate his atti- 
tudes, feelings, anxieties and expecta- 
tions as a parent and as a person. We 
also expected his defense pattern, his 
ego needs, and his impulse expres- 
sions and controls to manifest them- 
selves in the same context. 





* The parent behaviors are called influence 
techniques. The details of their conceptu- 
alization as well as the interaction se- 
quence within which they occur are de- 
scribed in detail (3). 
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We selected a TAT type of pro 
jective technique of thirteen cards 
depicting adult and child in various 
ambiguous poses. We selected cards 
which would depict all possible com- 
binations of parents and children in 
terms of sex. Thus we had a mother- 
son and a mother-daughter card, a 
father-son and a father-daughter card, 
family scenes of parents and children, 
cards of children alone and adults 
alone. Some of the cards came from 
the standard Murray set, others from 
Alexander’s set and the remainder we 
made up ourselves (1, 2). The cards 
we used gave a more representative 
range of parent-child inter-personal 
combinations than could be obtained 
from either of the two existing sets 
mentioned. 

This projective test was adminis- 
tered to all parents participating in 
our project. It was administered in 
the standardized fashion as described 
by Murray. We probably probed more 
than is usual in order to insure com- 
parable details for all records. 


Evidence about the influence tech- 
nique patterns of the parents was ob- 
tained through an interview in which 
the parent described in great detail 
the interaction between him and his 
child as it occurred the day prior to 
the interview. For mothers a single 
day was used, whereas for fathers a 
single day during the work week was 
used and a second interview was given 
to obtain data on a complete day at 
home. In every case the day described 
was the day prior to the interview. 
The interview was highly structured 
since a detailed chronological account 
was desired (4). The interviewer 
probed for omitted details and also 
asked the parent to state the rationale 
for his behavior, his judgment of the 
child’s feelings and attitudes during 
the interaction, and the success of the 
influence techniques used. 

Our procedure for exploring the 
usefulness of the projective test as a 
basis for predicting parental influ- 
ence techniques was to make predic- 
tions from the projective test and com- 
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pare these opinions with the parent's 
report in the interview. One judge 
analyzed the projective record, inter- 
preting the entire protocol within a 
modified psychoanalytic framework, 
with particular emphasis on themes, 
needs, and defense systems of the re- 
spondent. On the basis of the de- 
rived personality picture, predictions 
were made as to the influence tech- 
niques a parent used. The second 
judge independently analyzed the in- 
terviews for the influence technique 
patterns used by parent. The two sets 
of materials were then compared. 

We shall briefly present in case sum- 
mary form the salient feature of three 
sets of records. The three parents 
were selected from the twenty-two 
families involved in our study. All 
three are fathers of preschool chil- 
dren and to all intents and purposes 
are within the normal range of ad- 
justment. For each we shall present 
the projective material, the predic- 
tions, and findings from the interview 
material. Our predictions will be to- 
ward technique patterns, since we 
were unable to predict to specific iso- 
lated techniques. 

The first father reveals in his pro- 
jective a great deal of insecurity, un- 
certainty and doubt. In defense 
against this, he is overly self-con- 
fident, rigidly dogmatic, and oriented 
toward close control of his environ- 
ment. These characteristics are ego 
alien and he tends to project them 
onto others. Impulses are poorly con- 
trolled and their expression is justi- 
fied in terms of the demands of leg- 
itimate or self-ordained authority. He 
perceives the world as a depriving, 
hostile place in which he is denied his 
just due. He is, however, able to ex- 
press positive emotions in situations 
providing little or no threat. 

From this picture, it was predicted 
that the father’s influence techniques 
would be predominately negative and 
coercive. He would demand immedi- 
ate compliance, and be relatively in- 
considerate of the child’s needs. 
When, however, the child did not 
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threaten his authority, he could dem- 
onstrate sympathy and affection. 

The predicted pattern was clearly 
manifest in the interview. His tech- 
niques are largely negative, with high 
frequencies of prohibitions, threats, 
instilling fear, and the like. Explana- 
tions are rare and oversimplified. 
“Reasons” for his actions are given 
primarily in terms of his own wish. 
The techniques are coercive and dis- 
obedience is not tolerated. If immedi- 
ate compliance is not forthcoming, 
he threatens the child, and threats 
are invariably carried out when the 
child ignores them. Verbal and phys- 
ical expressions of affection occur but 
are generally reserved for those situa- 
tions in which the child complies im- 
mediately or spontaneously does what 
is expected, 

The second father shows strong 
needs for intellectual recognition and 
status achievement. These are re- 
flected in a compulsive drive to excel 
and make professional contributions. 
He evidences a general and pervasive 
egocentric orientation toward people, 
low frustration tolerance, and inade- 
quately developed defenses against 
aggressive impulses. When aggression 
is felt, he may project blame, but usu- 
ally he tends to withdraw with ac- 
companying feelings of guilt. 

It was predicted that the influence 
techniques used by this father would 
show by their content and timing little 
consideration for the child’s needs and 
feelings. It was further predicted that 
noncompliance would be highly frus- 
trating to him and would result in 
impulsive and drastic action. It was 
also predicted that he would fre- 
quently use overly intellectual tech- 
niques. 

These predictions are borne out in 
the interview. This father’s influence 
technique pattern indicates the fre- 
quent use of direct commands. When 
commands are not successful, he be- 
comes impatient, and without consid- 
ering the child’s needs or involve- 
ments in the situation, demands im- 
mediate compliance or impulsively re- 


acts with physical force. When com- 
mands or physical techniques are not 
applicable, e.g., in attempting to over- 
come fears, he uses lengthy and un- 
duly complicated explanations. At 
times, after several unsuccessful at- 
tempts to change the child’s behavior, 
he acquiesces and withdraws from the 
situation, frequently making some 
negative interpretation of the child’s 
behavior. He also indicates hostility 
toward the child in his occasional 
mockery and shaming. He has some 
intellectual awareness of children’s 
needs and as a result frequently in- 
itiates play activities in his child. 
Usually his interest quickly wanes, 
however, and he leaves to engage in 
some professionally relevant activity. 

The third father, in his projective 
data, shows the presence of strong and 
successful defenses against aggressive 
tendencies, mainly repression and re- 
action formation. Consequently he op- 
erates as a solicitous individual who 
is considerate of others, avoids hurt- 
ing their feelings, and in general tends 
to avoid conflict. He does not see 
hostility in others, except where obvi- 
ous. Emotional expression in general 
is controlled and there is little spon- 
taneity. He identifies strongly with all 
forms of societally sanctioned auth- 
ority, seeing them as benign. He is 
conservative in outlook and has strong 
needs for conformity to middle class 
social values. Although he is oriented 
toward obtaining approval and ac- 
ceptance from others, his level of self- 
acceptance is high. He appears to be 
generally well integrated and adjusted 
to his world. 

It was predicted that he would be 
characterized by showing a great 
amount of concern, consideration, and 
sensitivity for the child. He would 
successfully attempt to avoid many 
conflictful situations. He would use 
techniques which are positively orient- 
ed and have their effect by inducing 
the child to want to do what is ex- 
pected rather than coercing him into 
compliance. Being realistically orient- 
ed and sufficiently secure, however, he 
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could modify this pattern if the situa- 
tion so demanded. 


The extent to which the interview 
data bear out this prediction is strik- 
ing. Direct commands or prohibitions 
are generally avoided. When used they 
are always tempered with explana- 
tions, with demonstrations of affec- 
tion, or the injection of humor into 
the situation. Most techniques involve 
attempts to manipulate the child’s 
need system, e.g., making the desired 
behavior attractive for the child, mak- 
ing a game out of the desired be- 
havior, and playing with the child as 
a way of distracting him. There are 
many instances of reward and en- 
couragement. Potentially conflictful 
situations are frequently avoided by 
anticipating them and preparing the 
child gently and patiently, or by at- 
tempting to make the psychological 
atmosphere in the house a pleasant 
one. A conscious concern in most at- 
tempts to influence the child is the 
child’s feelings. 

Despite this orientation to avoid 
conflicts with his child, he is able, 
when necessary, to take a firm stand, 
and even to use physical force if neces- 
sary. In the few instances in which 
force is used, it is followed by some 
show of affection, explanation, and/ 
or reassurance. 

The above pattern tends to break 
down when the child shows aggres- 
sion clearly enough that it cannot be 
ignored or dismissed. Here the parent 
is apparently threatened enough that 
the defenses cannot operate smooth- 
ly. His response to this situation is 


Symposium 


awkward and unsure. He acknowl- 
edges concern in this area and is aware 
that some discomfort exists here on 
his own part. Although this was not 
predicted from the projective mate- 
rial, it is entirely consistent with it. 

The high degree of predictive suc- 
cess obtained appears to be a result 
of the following conditions: 1) using 
test stimuli which correspond con- 
tent-wise to the area of real life under 
study; 2) predicting from a coherent 
personality picture of the respondent, 
using the entire record; 3) concep- 
tualizing in advance the behavorial 
situation toward which the predic- 
tions are made. 

Of course, we still do not know 
how the personality picture of the 
parent obtained in our projective test 
compares in completeness with other 
types of more generalized projective 
tests. But we do feel that where lim- 
ited personality data are desired for 
predictive purposes, the approach sug- 
gested here is a fruitful one. 
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Discussion: Projective Techniques as Research Tools in Studies 
of Normal Personality Development 


SUZANNE REICHARD 


Until recently, the bulk of the 
large-scale Rorschach studies of norm- 
al children were limited to the simple 
establishment of age norms. This, of 
course, was an essential preliminary 
to any other type of research, such as 
investigation of the dynamics or vari- 
eties of adjustment in normal chil- 
dren, or of indications of psycho- 
pathology. With the publication of 
the McFate and Orr (8) adolescent 
norms in 1949 and the Ames, Learned, 
Metraux and Walker (1) norms for 
children two to ten years of age in 
1952, the objective of establishing 
normative Rorschach scores through- 
out the whole range of childhood and 
adolescence has been met. A further 
normative datum that has been estab- 
lished by Hertzman and Margulies 
(6) and by Ives, Grant and Ranzoni 
(7) is that the so-called “neurotic 
signs” of Harrower-Erickson (5) and 
the “adjustment signs” of Davidson 
(4) do not apply to adolescents, since 
more than fifty percent of the sub- 
jects showed such signs, One limita- 
tion on any generalizations about 
child development made on the basis 
of the above or other studies is that 
the sample populations investigated 
have almost always consisted of chil- 
dren of superior intelligence. We still 
do not know what the Rorschach 
scores and behavior ratings of strictly 
average children in the I.Q. range 90 
to 109 look like. 

After a long normative phase, 
there are signs that developmental re- 
search is about to enter a new, more 
dynamic phase. Dr. Crandall has just 
told us that the Fels Institute is now 
interested in studying the effect upon 
the development of the child of differ- 
ent varieties of maternal behavior 
within the normal range. In fact, in 


1952, Montalto (9) published a very 
interesting Rorschach study of the 
relationship of children’s adjustment 
to four different types of maternal 
behavior, namely, ideologically demo- 
cratic, restrictively cold, warm and 
spontaneously democratic, and re- 
strictively warm. An experience bal- 
ance pattern denoting affective sta- 
bility was most characteristic of the 
children of the spontaneously demo- 
cratic mothers and least characteristic 
of the children of restrictively cold 
mothers. 

Dr. Sigel is also interested in study- 
ing parental attitudes. Whether one 
devises new projectives, as he did, or 
whether one utilizes the standard 
techniques, probably depends on 
whether one’s aim is a kind of map- 
ping of the total personality, or a 
focusing on specific variables. For the 
latter, a new technique focused on 
such variables may have advantages. 

In reviewing the many studies of 
child development, whether by pro- 
jective techniques or other means, 
one cannot help but be struck by the 
fact that, although the rich source of 
testable hypotheses offered by the 
psychoanalytic theory of child de- 
velopment has long been available to 
us, so little use has been made of it 
in research. I find it very gratifying, 
therefore, that Dr. Ricciuti intends 
to utilize these hypotheses as the basis 
for his research. His quotation of the 
findings of Benjamin and Hilden (2) 
in regard to the two peaks of anxiety 
in childrens’ Rorschachs and _ their 
relationship to the psychoanalytic 
theory of the vicissitudes of the 
Oedipus Complex is an example of 
this type of research. Another inter- 
esting, but unpublished example of 
such research, this time emphasizing 
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psychoanalytic ego phychology, is 
Betty Borenstein’s study (3) of the 
relationship between Thematic Ap- 
perception Test fantasy and overt 
behavior in regard to two needs, de- 
pendency-frustration and _ object-ori- 
ented anger (verbal expression of 
aggression). The hypothesis tested was 
that the relationship between TAT 
and overt behavior would be depend- 
ent upon the inter-action of three 
factors: 1. The extent of experienced 
frustration; 2. Whether social de- 
mands are inconsistent with the needs; 
3. The kind of ego-functioning avail- 
able to the individual for dealing 
with the problems presented by con- 
flicting internal desires and social de- 
mands, The ego-functioning variables 
include tenuous ego controls, ego 
disintegration, withdrawal, tension- 
binding and wish-fulfillment or de- 
nial. For the purposes of the study, it 
was assumed that behavioral High 
Dependency would constitute a prob- 
lem for both boys and girls, and that 
High Aggression would be a problem 
for girls and Low Aggression for boys, 
because of lack of social acceptance. 
The major hypotheses were borne out 
by the findings. 

As regards future developments, I 
believe that the contributions of 
modern psychoanalytic ego psychol- 
ogy are especially promising for en- 
richment of our work with projective 
techniques. The biggest obstacles 
standing in the way of such fruitful 
interaction are methodological ones 
relating to the question of how to do 
justice to the structural and dynamic 
complexity of human psychic func- 
tion as it is expressed in test responses. 
The standard location, determinant 
and content scores, even when sub- 
jected to sign analysis or pattern 
tabulation, represent limited treat- 
ments that fail to take into account 
the full richness of Rorschach data. 
Rorschach workers have for some 
time been particularly aware of the 
limitations of Rorschach’s static con- 
tent categories, and several attempts 
have been made to find more dynam- 
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ically useful classifications. The best 
of these appears to me to be Schafer’s 
(11) proposed method of thematic 
analysis, that establishes classes of 
thematically and theoretically related 
images that pertain only to dynamic 
trends and are not, as with some of 
the other classifications, tied rigidly 
to any specific pathological syndrome. 
Some illustrations of this orientation 
are as follows: Dependent Orienta- 
tion (orality) is subdivided into 
supply, or oral-receptive orienta- 
tion, and demand, or oral-aggressive 
orientation. Included under the form- 
er are food, food sources, food objects, 
food providers, passive food receivers, 
food organs, nurturers and protectors, 
etc. Under the latter are included 
devourers, devouring, engulfing and 
overwhelming figures and objects, 
deprivation, oral verbal] assault, etc. 
Anal orientation and preoccupation 
includes direct anal reference, anal 
contact and perspective, dirt, and 
assault and explosion. Sexual atti- 
tudes are subdivided into fear of and 
rejecting attitudes toward masculine 
identity in men and fear of and re- 
jecting attitude toward feminine 
identity in women. For both sexes 
this includes reversal, combining, 
blurring and arbitrary assignment of 
sex characteristics to the blots, refer- 
ence to perversions, a hostile, fearful 
conception of the masculine role with 
phallic-aggressive emphasis, or on the 
other hand, castration emphasis, In 
addition, for men there is feminine 
emphasis on female clothing, materials 
and textures, and for women mascu- 
line emphasis on mechanical objects 
and athletics, Other categories deal 
with sado-masochistic orientation, 
authoritarianism, super-ego conflicts, 
rejecting attitude toward adult nur- 
turant, parental role, negative ident- 
ity or chronic feelings of failure and 
inadequacy, body narcissism, concern 
with reproduction or generativity, 
concern with aging and death, and 
emotional tone, 


Schafer’s improved content analysis, 
as well as Rapaport’s (10) analysis 
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of verbalisms, represent valuable re- 
finements of Rorschach interpreta- 
tion. However, it still is not enough 
to know that orality, anality or phallic 
impulses are important motivating 
forces in a subject; a person’s be- 
havior and level of adjustment will 
be very different, depending upon the 
matrix of primitive impulsivity, de- 
fensive and adaptive mechanisms in 
which they are embedded. In order 
to deal with this complexity, we need 
research designs that simultaneously 
take account of scores, content themes, 
and test attitudes and behavior. For 
this purpose, Schafer has recommend- 
ed the use of interpretations as our 
research units, rather than scores 
alone, or content alone. As he points 
out, “This total quantative and quali- 
tative approach takes into account 
the fact that similar interpretations 
may be arrived at on the basis of dif- 
ferent specific indicators.” So long 
as the patterns of specific indicators 
used are explicitly defined, there 
would seem to be no objection to 
such an approach. 


Now, as to applications of such a 
psychoanalytic ego psychological ap- 
proach to research in child develop- 
ment, they are obviously many. For 
instance, since Rorschachs have been 
collected on the Fels mothers, it 
would be interesting to establish pat- 
terns of maternal behavior by means 
of the Schafer method of using inter- 
pretations as research units and then 
relate these to the patterns derived 
from observation. One might examine 
childrens’ Rorschachs for evidences of 
Drs. Benjamin and Ricciuti’s valuable 
distinction between fundamental anx- 
iety and castration anxiety. One could 
hypothesize that the former would be 
associated with more disruptive signs 
of anxiety and mainly oral content, 
the latter with less diffuse or total dis- 
ruption of response and more content 
dealing with mutilation and missing 
parts. 


As regards child development, 


psychoanalysis sees maturation as a 
process of progressive defense against 
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and ultimate mastery of various bio- 
logical impulses. The application of 
Schafer’s method to children’s Ror- 
schachs would appear to provide us 
with a powerful tool for the investiga- 
tion of such developmental changes. 
It would be interesting, for example, 
to examine the content of the Ror- 
schachs in the Benjamin and Hilden 
study to see if themes having to do 
with castration anxiety and threaten- 
ing authority figures were especially 
prominent in the records of the five- 
year-olds, and content dealing with 
the problems of sexual identity in the 
records of the pre-puberty group. The 
likelihood of such findings is sug- 
gested by examination of content in 
the Ames, et al. series of Rorschachs. 
Phallic aggressiveness combined with 
castration anxiety was indicated by 
the prominence of violent human 
movement , responses, emphasis on 
sexual parts and mention of parts 
missing or cut off in the records of 
four-year-olds, Counter-phobic behav- 
ior, belittling the cards as silly, char- 
acterized four-and-a-half-year-old boys. 
Five-year-olds seemed to be more con- 
cerned with what goes on between 
“daddy” and “mummy.” Five-and-a- 
half-year-olds revealed anxiety related 
especially to large threatening figures, 
such as giants, ghosts and monsters. 
The Ames, et al. material gives hints 
of other interesting relationships be- 
tween Rorschach data and _ psycho- 
analytic theories of child develop- 
ment. Psychoanalysis places the start 
of the phallic stage of psycho-sexual 
development in the third year, and 
this is paralleled by the beginning 
mention of sexual parts in the Ror- 
schach. Formal school entry at six 
years of age marks the beginning of 
the latency period with its character- 
istics of increasing defense and sub- 
limation. It is not surprising, there- 
fore, to find that this is the age at 
which the Ames, et al. children for 
the first time gave an average of one 
human movement response, indicat- 
ing that primitive impulses were be- 
ginning to be brought under control 
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and subjected to delay. However, their 
Rorschach data raises some doubt as 
to whether the Oedipus Complex is 
resolved as quickly, or whether latency 
is as complete as psychoanalysis has 
assumed. Anxiety in the form of Clob 
responses, i.e. responses based on re- 
actions to diffuse shading, darkness 
and morbid content, reached an all- 
time high at seven years. Castration 
anxiety, in the form of content deal- 
ing with decay, damage and mutila- 
tion was still prominent. The typical 
obsessive-compulsive defenses of lat- 
ency first appeared in the records of 
eight-year-olds as qualification, un- 
certainty and demand for accuracy 
of responses. The presence of ana- 
tomical responses in the records of 
eight and nine-year-olds reflected un- 
easiness in regard to body image. In 
fact, a fair degree of stability, equil- 
ibrium and resolution of infantile 
problems did not seem to be achieved 
before age ten. 

I have gone into this re-examina- 
tion of the Ames, et al. material in 
some detail in order to illustrate a 
number of possibilities inherent in 
the combined application of psycho- 
analytic theory and the Schafer meth- 
od of Rorschach interpretation to re- 
search in child development. Much 
of what has been said in regard to the 
Rorschach would be equally applic- 
able to research with the TAT, CAT 
or other projective techniques, 
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Projective Techniques as Research Tools in Studies of 
Normal Personality Development 


WALTER Kass 
The Menninger Foundation 


A discussant is a critic whose “talk 
about talk ... has no serious value ex- 
cept perhaps as an expression of 
philosophy in the critic.” (3) With 
this citation from Santayana, I’m 
prompted to tell you first something 
of the viewpoint from which I read 
and appreciated the three excellent 
presentations. 


The three centers of research in 
human development represented on 
this panel all study personality proc- 
esses as they appear and operate in 
the child; all are concerned with the 
normal progress of these processes; 
and all employ projective techniques 
among others. These interests are 
also pursued at the Menninger 
Foundation by a research group asso- 
ciated with the Department of Child 
Psychiatry. Several years ago a team 
of clinical and social psychologists, 
a psychiatrist, a child analyst and a 
pediatrician began the study of coping 
patterns in normal pre-school chil- 
dren, most of whom are now in kin- 
dergarten, first and second grades. 
(8) The children had originally been 
selected and studied as normal in- 
fants by Escalona, Leitch, et al. (4) 
Three projective methods are used in 
this Coping Study, the Miniature Life 
Toy technique as developed and ap- 
plied by Lois Murphy (8), the Ror- 
schach, and the Children’s Apper- 
ception Test. The Rorschach and 
CAT are the techniques I have been 
working with, concentrating at this 
point on what can be learned from 
the stories children tell. 


To introduce my first general com- 
ment on projective techniques in 
child development research, I'll tell 
a story. Two military psychologists 
were discussing how to } ecm a pro- 
jective test to pick which troops 


should go to the tropics and which to 
the arctic. A social worker overhear- 
ing the conversation suggested a so- 
lution. “Why don’t you ask them?” 
My sympathies are with the sensible 
social worker, for I once had a teacher 
of social work who wisely cautioned, 
“Never neglect the obvious.” 


Obviously it is foolish and wasteful 
to seek by devious means that which 
is directly accessible. In recent years 
projective tests have proliferated 
from clinical practice into research. 
Their justification? A high reliabil- 
ity and a better than chance coeffi- 
cient of validity when correlated with 
clinical, observational or historical 
criteria. But many of the newer tech- 
niques, such as Sentence Completion 
and Situation Completion appear so 
patently close to the conscious cog- 
nitive and connative levels of ego 
functioning that what is gained in 
objectivity, speed of administration 
and scoring is often offset by the shal- 
lowness, meagerness and inconsequen- 
tiality of the material they convey. 
Projective techniques, their essence 
permitting, should of course comply 
with the rules of test rigor. But we 
should be no less rigorous in ascer- 
taining that the proposed methods 
are really more parsimonious and 
more useful than direct observation, 
direct inquiry or collateral sources of 
information; that they add new in- 
formation; or produce new insights 
for data already available from di- 
rectly accessible sources. 


Hoffman and Sigel say that when 
the projective technique and the con- 
ditions to be predicted are similar, 
predictability is enhanced, since the 
element of inference is thus reduced. 
But it seems to me the closer to the 
predicted behavior the form and op- 
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eration of your projective technique, 
the less projective the material you 
elicit will be. In other words, the 
more phenotypic the projective me- 
dium, the less inference is required, 
certainly. But also, the less genotypic 
the projective medium, the more lim- 
ited the range and usefulness of the 
rediction will be. The problem may 
= put in terms of length of infer- 
ence and depth of delving into psy- 
chic levels of consciousness optimally 
compatible with predictability. If we 
seek the central, cohesive, recurrent 
and therefore predictable aspects of 
ego functioning, we necessarily deal 
with very complex psychic processes, 
the projections of which require tech- 
niques of multiple parameters. Pre- 
dictability then becomes a matter of 
inferential integration, interpreta- 
tion and judgment on the part of the 
examiner—a time consuming proced- 
ure. The as yet not fully tested as- 
sumptions back of all projective tech- 
niques are first, that they are indirect 
time-and-labor saving devices to get 
at material more laboriously accessi- 
ble by direct means; and second, that 
projective techniques deliver mate- 
rial otherwise inaccessible in the sub- 
ject’s usual state of alertness and con- 
scious control. 

We tend to take these assumptions 
for granted and experience tells us 
they are true. But it seems to me we 
need a more convincing demonstra- 
tion of the economy of projective 
techniques and diagnostic testing 
generally both in clinical practice and 
research as compared with the more 
direct interview, observation, and 
molar experimental methods. For ex- 
ample, in a survey by Odum “the 
time required to complete a Ror- 
schach examination was estimated by 
166 Rorschach workers.” (9) The 
average was a little more than 4 
hours, the range from less than 2 to 
over 8 hours. If one uses a battery of 
tests, total time is even greater. In 
clinical work I sometimes wonder 
about the sheer economics of hours 
put into testing, recording, review- 
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ing, pondering, interpreting results, 
and reporting conclusions. I wonder 
about the worthwhileness of such 
heavy time investment if the most 
that can be said of a test’s contribu- 
tion is that its results correlate sig- 
nificantly with findings from dirett 
sources. Why work so long, so hard 
and so inferentially to duplicate data 
equally or more readily available by 
direct observation and inquiry? 

As for the assumption that projec- 
tive techniques yield material other- 
wise inaccessible during normal states 
of conscious censorship, how can we 
test and prove this? Schafer (10) and 
Bellak (1) suggest similar approaches. 
Schafer describes the Rorschach re- 
sponse process as a balance of pro- 
gressive, adaptive and creative forces 
versus regressive, autistic trends, shift- 
ing among psychic levels along a 
“dream-percept continuum” of 
dreaming, day-dreaming, purposeful 
visualizing and normal perceiving. 
Bellak also deals with the question of 
levels .of consciousness to which pro- 
jective techniques penetrate. His con- 
tinuum includes the dream, hypno- 
gogic states, preconscious fantasy, day 
dream, free association, artistic crea- 
tion, and a separate category of pro- 
jective test responses. Bellak also re- 
fers to experimental applications of 
projective techniques during hyp- 
notic or less than fully conscious 
states. The child’s psychic life is less 
complex than the adult’s. His verbal, 
graphic and dream expressions are 
less disguised, and the projected rep- 
resentations of his inner life are more 
patently understandable and _verifi- 
able. 

As in the clinical case study method, 
so in research, we don’t know what 
to do with test results which are not 
compatible with the criterion meas- 
ure. For example, Crandall described 
a Fels study of maternal behavior in 
which mother’s self-ratings correlated 
positively and, in many relationships, 
significantly with ratings by home vis- 
itors. But, “in none of the relation- 
ships was as much as half of the vari- 
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ance held in common between the 
two ratings ... Self-reported mater- 
nal behavior was not the same as ob- 
served maternal behavior.” How 
should we construe such differences 
between subjects’ self-perceptions and 
objective ratings of behavior presum- 
ably emanating from the subjects’ 
core self-concepts? Rating scales and 
simpler projective tests are good first 
steps. But I think those complex tech- 
niques, like the Rorschach, which use 
the method of inquiry for pursuing 
and elucidating the projections in the 
test point the path to closer correla- 
tions between subjective psychologi- 
cal experience and objective inter- 
pretation of underlying dynamic 
processes. Inquiry into responses pro- 
vides a means of deeper penetration 
into the subject’s psychic life, leaving 
less to speculation and inferential in- 
terpretation via score formulas and 
selected test “signs”. Predictors of the 
sign, equation, or formula type to 
which projective tests are commonly 
reduced are usually too empirical and 
unnecessarily “blind”. At their very 
best these predictive devices enable 
us only very mechanically to foretell 
an end product. They tell us nothing 
about intervening processes or devel- 
opmental evolutions through which 
the predicted end states are attained. 

Inquiry is, of course, standard pro- 
cedure in the Rorschach, Word Asso- 
ciation and other tests. Following 
Bettleheim (2), Luborsky (7) recently 
described the benefits of inquiry with 
the Thematic Apperception Test by 
asking subjects for self-interpretations 
of their TAT stories, Holt and Lub- 
orsky (5) found this a useful research 
method in assessing the psychological- 
mindedness of applicants to the Men- 
ninger School of Psychiatry. I have 
regarded self- interpretations of TAT 
stories as presumptive work-samples 
of a patient’s capacity to recognize 
and understand expressions of his 
own psychic processes, and have used 
this clinically as a method of apprais- 
ing amenability to psychotherapy. 
Psychoanalysts rarely interpret dreams 
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without the dreamer’s free-associa- 
tions to the dream and extensive 
knowledge about his life and person- 
ality. Why do psychologists presume 
to make important interpretations of 
the manifest forms and contents of 
projective tests without further in- 
quiry into latent meanings? The in- 
trospective method was long ago 
abandoned by psychology in_ its 
growth toward objective science. 
Coupled with the projective tech- 
nique, introspection appears once 
again to be gaining respectability as 
a method of personality investiga- 
tion. I suggest that, as psychologists 
find further freedom from their test 
ties and make more first hand exam- 
inations of psychic phenomena, new 
dimensions will be added to projec- 
tive techniques. 

Both Crandall and Hoffman and 
Sigel have referred to the problem of 
defining what is normal. If one con- 
siders projective responses as prod- 
ucts at a point in time of a continu- 
ous and pre-existing personality 
which at an earlier developmental 
period was also a pre-rational person- 
ality, then one must expect to find in 
the projective material residuals and 
resurgences of, as well as regressions 
to, pre-logical thought forms and im- 
mature affect modes to some extent 
as characteristic of normal mentation, 
emotion, and action. The question is 
to what extent may these occur and 
with what degree of resilience should 
the child maintain the development- 
ally more mature and age-appropri- 
ate modes. The answer calls for fur- 
ther research in the borderland be- 
tween the rational and irrational, the 
logical and prelogical, the mature and 
the infantile, the adaptive and the 
maladaptive. 

Perhaps as many serious behavior 
and personality problems are abided 
and lived with today in homes, 
schools and communities as are 
brought to clinics for study and treat- 
ment. What does this mean when in 
research normal is defined in dichot- 
omized terms of non-clinical versus 
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clinical populations, and when exper- 
imental and control groups are cho- 
sen by this broad division? One small 
operational way to clarify and de- 
limit the concept of the normal for 
certain research purposes is to use 
the projective technique in a self- 
limiting and self-norming manner. 
For example, there is sufficient knowl- 
edge and agreement about what con- 
stitutes a pathological response on the 
Rorschach. When such __ responses 
abound, pathological protocols may 
be eliminated. Thus, one can a priori 
preclude extremely deviant cases from 
the research population. As one who 
tried this procedure in a predictive 
Rorschach study with adults, (6) I 
can tell you that it makes the task of 
valid differentiation and reliable pre- 
diction enormously more difficult 
when you pre-experimentally elimin- 
ate one end of your population dis- 
tribution. This kind of precaution in 
a research design is not without 
precedent. It is ordinarily done in 
defining the limits of one’s investiga- 
tion. Usually, however, the delimita- 
tion is according to external criteria 
and not, as I am proposing, in terms 
of the research instrument itself, This 
is a procedure of ag the re- 
search population by screening out 
from the start those subjects identi- 
fied by the projective technique it- 
self as abnormal, or even suspect, de- 
pending on how far one wants to re- 
fine the group. In this way the pro- 
jective technique does double duty, 
first as an initial screening device, 
and thereafter as a modality of the 
research proper. If this is done, we 
may not only be in a better position 
to examine how normal child devel- 
opment progresses when viewed 
through projective techniques, but 
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we may also more intensively estab- 
lish the descriptive, discriminating, 
and predictive powers of the projec- 
tive technique in its own self-defined 
range of normal functioning. 

In concluding these general com- 
ments, I want to thank Drs. Cran- 
dall, Hoffman and Sigel, and Ric- 
ciutti for the stimulation of their 
thinking. In the open discussion later 
I'll comment more specifically on the 
fine points of their papers. 
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The Rorschachs of Selected Groups of Children 
In Comparison with Published Norms: | 


The Effect of Mild Hearing Defects On Rorschach Performance 


MIRIAM FORSTER FIEDLER 
Smith College and Clarke School for the Deaf 


and 


L. JosEPH STONE 
Vassar College 


As part of a study of the educa- 
tional adjustment and personality de- 
velopment of hard of hearing chil- 
dren undertaken by the Department 
of Child Study of Vassar College un- 
der a grant from the Estate of Lester 
N. Hofheimer, a group of children 
with slight to moderate hearing de- 
fects was selected for study (2) on the 
basis of a screening test of hearing ap- 
plied to several grades in the Pough- 
keepsie public school system.’ For 
various purposes in the overall study 
a control group with normal hearing 
was established in which each mem- 
ber was matched to one of the experi- 
mental group for age, sex, school and 
neighborhood and _ socio-economic 
status. The present report deals with 
an analysis of the Rorschach records 
of children with hearing defects in 
comparison with the records of their 
matched controls.” 


SUBJECTS 


For the analysis of the Rorschach 
characteristics of children with defec- 
tive hearing, ten matched pairs of 
children were used. Table I indicates 
the age, sex and estimated socio-eco- 
nomic status® of the ten children with 





*Grateful acknowledgment is made to the 
Superintendent of Schools, Fox D. Holden, 
and the then Assistant to the Superinten- 
dent, Carl E. Lewis, and the principals and 
teachers who cooperated in the study. 

? The ten “best” cases of hearing loss chosen 
from a larger group of 16 on the basis of 
presence of binaural hearing loss substan- 
tiated by pathological medical evidence, and 
duration over a period of three years as 


evidenced by repeated audiometric tests. 
* Estimate based on occupational rating of 


hearing defects (Group A) and their 
matched controls (Group B) and an 
estimate of the degree of hearing loss 
of the experimental subjects. 

An additional group, A’, of six 
children with severe hearing handi- 
caps was also studied. Because there 
is only a small number of such chil- 
dren, varying in age from three to 
eight, no attempt is made to compare 
them with the other children in sta- 
tistical terms. 


PROCEDURE AND FINDINGS 


The Rorschach protocols of these 
children were submitted for analysis 
to Bruno Klopfer,* at first without 
designation to indicate which chil- 
dren were known to have hearing de- 
fects in order not to bias the scoring 
and interpretation. It proved impos- 
sible to distinguish the children with 
and without mild to moderate hear- 
ing losses by “blind” examination of 
the Rorschachs. 

The proper designations of normal 





father (or mother) as follows: I. Profes- 
sional; II. Semi-professional, large business, 
important managerial; III. Skilled labor, 
small business, minor managerial; IV. Semi- 
skilled labor; V. Unskilled labor. 

* The administrators of the Rorschachs were 
all trained by Klopfer or his students. In 
addition to the authors, these included Lucy 
Bodlander and Annette Porter. Apprecia- 
tion is expressed for their assistance. The 
Rorschachs were collected in the period 
1947-1950. Dr. Klopfer arranged for their 
analysis by Mrs. Winafred B. Lucas and the 
results of these analyses were discussed in 
conferences with Dr, Klopfer and one or 
both of the authors. Grateful acknowledg- 
ment is made to Mrs. Lucas and Dr. Klop- 
fer for their interest and generous coop- 
eration. 
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TABLE I—Age, Sex, Socio-Economic Status and Degree of Hearing Loss 
for the Groups Studied 
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Defective Group B 
Hearing Controls 
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oe oP O o a eae te ORE PUONCanee e 6:4-13:0 7:3-12:8 
(eight, 8:0-11:5) (eight, 7:3-11:6) 
Sex 
a een ee re rata, 5 5 
PON ia aaa cs caesnccc ca sac saat caseenescasncseeecacsadetyascuamnasdecesisce > 5 
Occup. rating 
| BRS RN RAE ee ere ee ee Penn ee are 1 l 
esas pases spss scoet snus sees yi ssgansesaicpshassatncnetesescatessepesOiseoce 1 1 
on RE OREAS CORN ee Oe Oe TE ae ee 3 2 
eta cops foc saeae sat aLy aes sectaaccoesasvehicaiabs 4 2 
1 RIOR ie eters neer eee ene nL Ce 2 3 
AMA rating.............. 3.6-47.3%, Normal 
of hearing loss Mdn. 6.8% 


or impaired hearing were then sub- 
mitted to the Rorschach analysts and 
they attempted to find, empirically, 
common attributes in the Rorschachs 
of the children with hearing defects 
which would differentiate them from 
the control children. A comparison of 
differences in mean scores between 
two groups was made for each of 
twenty-four Rorschach scoring cate- 
gories. For those differences which on 
inspection seemed possibly significant 
the ¢ test of significance for the dif- 
ference between correlated means was 
computed (3, p. 225-226). The Ror- 
schachs of the children with mild to 
moderate hearing defects showed 
no statistically significant differences 
from those of the children with nor- 
mal hearing. 


On the assumption that the hear- 
ing loss might, nonetheless, impose 
deprivations which would influence 
personality and which might be evi- 
dent in terms of a cluster of Ror- 
schach traits, a “deprivation syn- 
drome” was set up by Klopfer and 
Lucas and the groups compared in 
terms of its incidence. It should be 
added that before the analysts had 
been informed of the designation of 
“normal” or “impaired” hearing they 
had found it possible to characterize 
a considerable number of the children 
as showing such a syndrome. This 
syndrome consists of a cluster of the 


following Rorschach characteristics: 

(1) “Blunting of affect”: this has in com- 
mon with what I usually term “bland 
discomfort in the presence of color 
affect” an absence of marked signs of 
stimulation. It does not exclude such 
intensive reactions as blood or fire, but 
where these occur they are not given 
in the _ cold-blooded, matter-of-fact 
way which characterizes bland affect. 
However, blunted affect lacks the ex- 
pression of discomfort or excitement 
which is typical for the more normal 
child. 

(2) Erratic form-level: marked variation in 

definiteness and adequacy of the use of 
form. (This was especially conspicuous 
in the records of the more intelligent 
children.) 
Emotional retardation: the use of col- 
or is approximately two years below 
the differentiation typical for the child’s 
age.® 

The dynamics which were assumed 
to underlie this deprivation pattern 
were the effects of the handicap in 
communication, which tends to iso- 
late the child with defective hearing, 
in combination with the compensa- 
tory attention which such a child 
might get because of his handicap. 
This combination might produce the 
“blunting of affect” (instead of a 
“flattening of affect,” which isolation 
itself would bring about), This is in 


(3 


~~ 





5 Quotation from summary of the Rorschach 
analyses received from Dr. Klopfer. 
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contrast to the normal differentiation 
which unhampered communication 
would produce, The same combina- 
tion might well produce an uneven 
use of intelligence in the more able 
children. 

After the hypothesis of the depriv- 
ation syndrome was set up, the Ror- 
schach records of the children in 
Groups A and B were examined for 
the presence or absence of the three 
characteristics above. It was found im- 
possible to distinguish the children 
with defective hearing from their nor- 
mal controls in a more than chance 
fashion on the basis of the depriva- 
tion cluster of characteristics. For in- 
stance, in the ten matched pairs re- 
ported in this article, 6 children of 
Group A showed none of the syn- 
drome and 4 the complete syndrome. 
Of Group B, 3 showed none, 2 a 
partial pattern (two characteristics), 
and 2 the complete syndrome. 

It is possible thatthe hearing losses 
of most of the children in Group A 
were too slight to result in the hypo- 
thesized effect of the deprivation syn- 
drome. However, when the records of 
the 4 children in Group A with losses 
of 25% or more and those of the 6 
children in Group A’ with severe 
losses (A.M.A. ratings of losses of 
60% or more) (1, p. 158) were exam- 
ined, three of the records showed 
none of the characteristics of the dep- 
rivation syndrome and 3 showed a 
partial pattern (two characteristics). 
Similarly, when the data were exam- 
ined on the interpretative level by 
the Rorschach analysts, estimates 
made of such characteristics as “psy- 
cho-sexual level,” “degree of anxiety,” 
“intellectual functioning and poten- 
tial,” and “general adjustment,” yield- 
ed no differentiation of the two 
groups. 

CONCLUSIONS 
The conclusion from these exam- 


inations of our data was that in this 
small sampling no single Rorschach 
factor or pattern of factors, on the 
basis either of scoring or interpreta- 
tive analysis, could be found which 
would consistently differentiate the 
children with defective hearing from 
the children with normal hearing. 
Nor did the Rorschach evidence of 
disturbances in the personalities of 
the severely handicapped group of six 
children differ in quality and quan- 
tity from those in the mild to moder- 
ately defective hearing group or the 
control group. 


With reference to this finding, it 
is interesting to consider that had the 
Rorschachs of the children with hear- 
ing defects been compared only with 
expected norms, and no control group 
employed, the investigators would 
have been badly misled; it would 
have appedred that the “deprivation 
pattern” was characteristic of children 
with hearing defects. That is, it was 
only through the use of matched con- 
trols that it became evident that not 
only the experimental subjects but 
also the normal control subjects dif- 
fered from “normals.” Hence it 
seemed reasonable to examine a new 
hypothesis: namely, that since both 
groups were of low socio-economic 
status, the Rorschach was sensitive to 
personality concomitants of socio- 
economic status. Part II will describe 
the testing of this hypothesis, 
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The Effect of Socio-Economic Status On Rorschach Performance 


MIRIAM FORSTER FIEDLER 
Smith College and Clarke School for the Deaf 


and 


L. JOSEPH STONE 
Vassar College 


Part 1(6) reported a study of the 
Rorschach records of ten school-aged 
children with hearing defects com- 
pared with those of their matched 
controls. The conclusion of the study 
was that in these records no single fac- 
tor or pattern of factors, on the basis 
either of scoring or interpretative 
analysis, consistently differentiated the 
two groups. Both groups, however, 
showed a high incidence of what was 
called a “deprivation syndrome.” Since 
this syndrome was found in both 
groups it appeared that it might be 
associated with low socio-economic 
status rather than with hearing loss. It 
seemed important to set up a study 
to test the hypothesis that the Ror- 
schach was sensitive to personality 
concomitants of socio-economic status, 
since the results of such a study might 
alter the general acceptance of pub- 
lished age norms. The present report 
deals with the testing of this hypo- 
thesis. 

Since the concept of the “depriva- 
tion syndrome” used in Part I seemed 
too diffuse and qualitative to permit 
further analysis, the present compari- 
son is based on the frequencies of oc- 
currence of various Rorschach scores. 


SUBJECTS 


To test the above hypothesis we 
gathered a group of children of low 
socio-economic status for comparison 
with published norms. Eight of the 
ten cases of children with defective 
hearing described in the previous 
study were pooled with their normal 
hearing matched controls, omitting 
two pairs of children of high socio- 


economic status. To this group were 
added seventeen more children, some 
of them normally hearing children, 
others children with only marginal or 
doubtful losses or mild losses in the 
high frequencies only. All thirty-three 
children were of low socio-economic 
status (Table I). 


PROCEDURES AND FINDINGS 


The Rorschach protocols of twenty- 
five of these children, as described in 
Part I, had been submitted for an- 
alysis to Bruno Klopfer (6, p. 273). 
Eight other protocols not submitted 
to Dr. Klopfer were scored by com- 
parable procedures. A recent publi- 
cation by Ames et al (1) provided 
norms for children at each year of age 
for ready comparison with these chil- 
dren, Fortunately the Ames publica- 
tion contained a description of the 
socio-economic status of her groups, 
an examination of which made it 
obvious that the Ames norms actually 
were derived from children whose 
homes were predominantly middle- or 
upper-class, Our experimental group 
(E-group) was essentially lower-class, 
with very little overlap between 
Ames’ and ours.! 





*It will be noted in Table I that for ten 
cases of the E-group the occupational rating 
is III. However, for more than half of these 
children there were present depressing fac- 
tors in the home situation which made their 
homes comparable to those with ratings IV 
and V, e.g., one family of a skilled mechanic 
was considered as a “typical welfare family” 
by social agencies: dirty, ill-managed, etc. 
Another skilled mechanic was a drunkard 
with court records for disorderly behavior, 
etc. All but one of these ten families lived 
in the poorest section of the city. For these 
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Thus the comparison of this E-group 
with the Ames norms provides the 
basis for a study of socio-economic in- 
fluences on the Rorschach. 


Inspection showed that the Ror- 
schach data for the E-group departed 
considerably from the Ames norms. 
To emphasize this disparity the num- 
bers of the E-group children who were 
at or above the Ames 75th percentile 
or at or below the Ames 25th per- 
centile (for corresponding age) were 
found in each of the scoring cate- 
gories considered by Ames and her 
co-workers.2, Table II presents these 
figures with the results of the analysis 
of the statistical significance of the 
differences as tested by the use of 
chi-square, using the Yates correction 
for continuity because of the small- 
ness of the samples involved (7, p. 
278). It is immediately obvious that 
the E-group children deviate from the 
Ames norms in about half the scor- 
ing categories. Thus, of the 33 chil- 
dren in the E-group, 19 score at or 
above the Ames 75th percentile for 
FM, 17 for FC, 19 for R, all differ- 
ences being statistically significant at 
less than the .01 level. Of the 33 chil- 
dren, 14 score at or above the 75th 
percentile for FC, 15 for P and 15 for 
A%, differences significant beyond the 
.05 level of confidence. Examination 
of the number of children scoring at 
or below the 25th percentile gives 
other highly significant deviations 
from the Ames norms. Of the 33 chil- 
dren in the E-group, 18 scored at or 
below the 25th percentile for W%, 
15 for Dd%, and 15 for CF, In addi- 
tion, only one child scored at or be- 
low the 25th percentile for m. All of 





reasons, the contrast between the experi- 
mental group and the Ames group is more 
marked than Table I might suggest. Three- 
fourths of the Ames children came from 
homes rating as I or II on a similar occu- 
pational rating scale. 

® Unfortunately, Ames et al instead of using 
one of the scoring systems now standard in 
the U. S. have introduced the modifications 
of Loosli-Usteri. Because this involves con- 
siderable difference in shading scores, those 
categories are omitted. 


these differences were statistically sig- 
nificant. It will be noted that CF and 
possibly P show a piling up of re- 
sponses in the E-group both below the 
Ames 25 percentile and above the 75th 
at the expense of the middle range. 
It will also be noted that not all of 
these differences lie in the “expected” 


Tas_e I, E Group 
Low socio-economic status 
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TABLE II. Comparison of the E group 
with Ames Norms Rorschach Scores* 















































N above 
Ames 75th 
percentile 
score x? p 
Eon 
16.97 <.01 
11.00 <.01 
4.45 <.05 
2.27 ene 
2.92 09 
15 5.90 “015 
A%G 15 5.90 015 
19 16.97 <.01 
N below 
25th 
percentile 
score xX? P 
9.70 <0l 
<.01 
9.70 <.0l 
6.30 <.05 
9.70 <.01 
13.82 <0l 
6.30 <.05 
171 <.20 
3.64 “06 








* E group, N = 33 
Ames, N = 50 at each age level. 
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TABLE III. Comparison of Children Over and Under 
11 Years of Age for Ames Norms 








M 
2) | EE nace ane rnE neo ee % 
NNN crac ch cep csreeaenes 42% 
Age 11 ly 
Age under 11 11% 





TasLeE IV. Comparison of Rorschach 
Norms for 8-year-old Children 
(Mean scores) 


Ames Carlson E group 
50 100 10 

55 35.88 40.9 

37 51.3 41.7 

15.86 20.13 18.8 

24 22.56 16.8 

45 46.66 45.7 





direction of deprivation, and impov- 
erishment: there is also evidence of 
earlier maturity in the Poughkeepsie 
sample. A comparison of the E-group 
children who were eleven years or 
older (7 children) was made with 
those under eleven (26 children) for 
those categories whose scoring devi- 
ated markedly from the Ames norms 
(Table III), There was no evidence 
that the suggestion of “earlier matur- 
ity” was due to the weight of the 
scores of the seven children who were 
over eleven years of age. 


Before it is possible to discuss these 
differences it is necessary to examine 
the distinctions between the groups 
more closely. As noted previously, 
three-fourths of the Ames children 
came from families in the profession- 
al and managerial groups rated as I 
and II, while most of the Poughkeep- 
sie children in the E-group came from 
families rated IV and V, semi-skilled 
and unskilled labor. There would ap- 
pear to be, then, a clear-cut compari- 
son of socio-economic differences be- 
tween the E group and the Ames 
groups. By implication, we cannot 
then assume that the Ames figures are 
truly normative. This raises the im- 
portant question for future Rorschach 
research as to whether it is better to 
obscure these differences by combin- 


Above 75% percentile 
0 


FM CF w% P AY 


14% 43% 56% 


62% 45% 1% 45% 4997 
Below 25% percentile 
28 


, 36% 2% 14% 
ee 38% 54% 38% 19% 


ing groups of different socio-economic 
status or to keep the norms for each 
group separate. Ames points out that 
the one study to date of the socio- 
economic differences as related to 
Rorschach scores (4) found socio-eco- 
nomic level not significantly related 
to Rorschach scores but that Cron- 
bach has suggested that more appro- 
priate statistical treatment of the data 
would have revealed several signifi- 
cant differences (1, p. 16). There may 
well be other differences between the 
Ames group and the sample of Pough- 
keepsie children, but there is no evi- 
dence that Ames’ or the Poughkeepsie 
group is atypical in any respect other 
than socio-economic status (especially 
since it is clear from the data of Part 
I of this study that the presence of 
children with hearing defects made no 
significant difference as such). 


With the thought that some light 
might be thrown on this issue by com- 
paring some of the data for the E 
group and from the Ames tables with 
other normative studies, scores for 
the ten 8-year-olds in the E group 
were compared with Carlson’s norms 
(2) for 8-year-olds. Table IV contains 
the results of this comparison of the 
E group, the Ames and the Carlson 
norms for five scoring categories. For 
three of these categories, W%, D%, 
and R, the E group children occupy 
a midway position between the Ames 
and Carlson norms, with the Carlson 
norms representing a wider sampling 
of socio-economic levels than Ames’s. 
At the request of the authors of this 
article, Carlson made a more detailed 
analysis of responses of her children 
from different socio-economic levels. 
Using the chi-square technique for 
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differences between a ‘high’ grou 
(rating I-III) and ‘low’ (IV-V), Carl- 
son found a very significant difference 
for CF% and a result approaching 
statistical significance (P= .10) for 
FC%, in both cases the children of 
higher socio-economic status utilizing 
more color. Using a different dichot- 
omy (I, II vs. II, IV, V) she found 
children of the lower levels gave sig- 
nificantly more A responses. None of 
the other scores differentiated _be- 
tween socio-economic levels regardless 
of the grouping employed. Differences 
may have been obscured by the fact 
that Carlson’s ratings of socio-eco- 
nomic status were made on the basis 
of rental indices rather than parental 
occupation. 


CONCLUSIONS 


A clear-cut difference between Ames’ 
high socio-economic group and our 
low socio-economic group is evident. 
The comparison with the Carlson 
data does little to clarify the prob- 
lem of interpretation of these find- 
ings, but does reinforce our question 
regarding the validity of the Ames 
norms for children from all levels of 
society and our suggestion that we 
must obtain appropriate norms for 
children of various socio-economic 
levels. In view of the discrepancies in 
the three sets of findings and in view 
of the relatively small samples used 
for all three sets of data, it seems pru- 
dent to eschew the temptation to 
speculate now over the psychological 
pressures related to low socio-eco- 





*From personal correspondence of the auth- 

ors with Rae Carlson, September 1952. 
Grateful acknowledgment is made for her 
interest and cooperation in re-examining 
her data. 


nomic status (such as earlier respon- 
sibility and the need to assume in- 
dependence, as well as environmental 
deprivation factors) which might ac- 
count for the striking apparent dif- 
ferences between our E-group and the 
Ames group. The Rorschach tech- 
nique may prove to be a very acces- 
sible and insight-revealing method for 
the study of the psychological impact 
of socio-economic factors, but at this 
point it is obvious that what is need- 
ed is much more Rorschach material 
on large, well-defined samples of chil- 
dren differing in socio-economic 
status. 
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A Factor Analysis of Rorschach Determinants 


RICHARD COAN 
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Since 1947, a number of factor 
analyses of the Rorschach have been 
published. They may be considered as 
of three general types, according to 
whether their major concern has been 
with content, diagnostic signs, or scor- 
ing categories. The only factor an- 
alysis of diagnostic signs is that of 
Hughes (5), who employed a com- 
bination of psychoneurotic, organic, 
and schizophrenic signs. Two other 
early studies, by Hsii (4) and by Wit- 
tenborn (10), dealt with content. Wit- 
tenborn secured responses to the Har- 
rower-Erickson check list, analyzed 18 
of the items on the list, and attempted 
to draw generalizations regarding the 
unitariness of the major determinant 
categories. 


Hsii’s study, however, is of greater 
interest at the moment, since it fore- 
shadows a finding common to all sub- 
sequent factor analyses of formal scor- 
ing categories. Very limited generali- 
zations from Hsii’s data are warranted, 
because of the special circumstances 
of this study. Hsii used only the first 
card of the test and secured responses 
—evidently at a Halloween party — 
from 76 children, all of whom were 
clients at a clinic. The prominence of 
such a response as “pumpkin” should 
especially suggest due caution in in- 
terpreting the data. Hsii analyzed 15 
scores, including total time, number 
of words, number of nouns, number of 
adjectives, number of verbs, use of 
numbers, and nine general content 
categories, It is the first rotated factor 
that is of interest. In view of its high 
loadings for scores obviously related 
to the length of the protocol, Hsii in- 
terprets it as a factor involving facility 
in using words and associating to the 
stimulus material. In reference to this 
study, Adcock (1) speaks of the factor 
as one of “fluency.” 


The major factor analyses of con- 
ventional scoring categories have been 
those of Adcock (1), Cox (2), Sen (7), 
Williams and Lawrence (8, 9), and 
Wittenborn (11, 12). These studies 
have involved varying selections of 
scores and widely different types of 
subjects, but they have one major 
finding in common. Each has turned 
up a “productivity” or “fluency” fac- 
tor. Some psychologists have been im- 
pressed with the persistence of this 
factor, as though it had some special 
psychological significance, But its pri- 
mary significance probably lies in its 
inevitability in the factor analysis of a 
matrix containing the spurious cor- 
relations of a set of systematically in- 
terrelated scores. R (the number of 
responses in the protocol) invariably 
has a high loading on some such fac- 
tor. Where determinant scores have 
been used, F has had the highest load- 
ing. Of the location scores, the detail 
scores tend to have high loadings, 
whether a simple summative score or 
a percentage score is used, since few 
subjects can give many suitable whole 
responses, and the more one breaks 
up the stimulus perceptually, the 
more possibilities there are for dis- 
crete responses. 


Adcock (1) found such a factor for 
a matrix composed almost entirely of 
percentage and ratio scores—the usual 
part-whole correlations being thus 
avoided. He made two analyses, one 
for the responses of 88 native children 
of Cook Island and one for the re- 
sponses of 30 New Zealand children. 
The results for the two groups are 
surprisingly consistent. Three factors 
show high loadings for roughly the 
same variables. Adcock refers to the 
factors as fluency (with high positive 
loadings for R, Dr%, and S), phantasy 
or introversion (with loadings for 
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M:C and H%), and intelligence or 
“practical common sense” (D%, H%, 
R, and Dr%, having high loadings). 
A fourth factor shows different pat- 
terns of loadings in the two cultures, 
but Adcock felt that a “constriction” 
factor might be involved in both 
cases. 

Sen (7) found somewhat similar 
factors in a factor analysis of 36 scor- 
ing categories for responses obtained 
from a sample of 100 Indian students. 
Tetrachoric correlations were anal- 
yzed by Burt’s method of simple sum- 
mation, and three factors were found. 
Sen felt that these involved respect- 
ively fluency of association, the ability 
to see relations, and fantasy thinking 
as against concrete and _ practical 
thinking. Re-examining Sen’s findings, 
however, Eysenck (3) felt that the 
third factor might better be consid- 
ered a “neuroticism” factor, while the 
second might be considered an “in- 
telligence” factor. 

Productivity (or “fluency”), normal 
adjustment (as against neuroticism), 
and intelligence factors were also 
found by Cox (2), who studied the re- 
sponses of 60 normal boys, selected 
from school, and 60 psychoneurotic 
boys, who attended a clinic. The 
school-clinic dichotomy and Raven IQ 
were included among the scores as 
reference variables. The factor an- 
alyses of scores done by Wittenborn 
(11, 12), however, are probably of 
more far-reaching implications, for 
separate analyses were made for a 
group of normals (Yale undergradu- 
ates) and for a group of neuropsychi- 
atric patients, using the same set of 
Klopfer scoring categories. These twin 
studies permit a comparison that pre- 
vious studies have not permitted. 
There are factors that may relate to 
the level of mental health, but it is 
also evident that the level of mental 
health of the group studied will influ- 
ence the factorial composition of the 
scores. There is, to be sure, a “pro- 
ductivity” factor for each group, with 
high loadings for R, D, Dd, d, and F, 
but even here there are important 
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differences. For the normal group, M 
and FM have high loadings on this 
factor; for the psychiatric group, m 
has a high loading, but the loadings 
for M and FM are low. For the nor- 
mals, a factor representing a “low 
order of perceptual control’ was pre- 
dicted and it materialized, with high 
loadings for W, CF, C, c, and K. This 
and a similar factor found for the 
psychiatric group may correspond to 
the neuroticism factor of Sen and Cox. 
In both groups, there is something 
that might be called an “originality” 
factor, but there are marked differ- 
ences. A high loading for M in the 
normal group suggests a factor akin to 
creativity, while Wittenborn feels that 
the prominent joint loadings for $ 
and O in the psychiatric group are a 
function of the fantastic originals of 
the psychotic subjects. In the psychi- 
atric group, D, M, FM, FK, C’, FC, 
and R form a fourth factor. In the 
normal group, a possible fourth fac- 
tor is formed by P, O, K, C, and c. 

It may be noted in passing that in 
the normal study, Wittenborn made 
an issue of the fact that the factorial 
composition of FC was more like that 
of M than like that of CF or C. He 
felt that the discrepancies among the 
color categories and among the move- 
ment scores suggested an incorrect 
emphasis in present scoring practices. 
Wittenborn seems to believe, however, 
that Rorschach theory assumes more 
factorial unity for the movement scor- 
ing categories and for the color scor- 
ing categories than it does, Were not 
at least some factorial differences ex- 
pected, the distinctions between FC, 
CF, and C and between M, FM, and m 
would not be made. On the other 
hand, there are certainly reasons, from 
the standpoint of Rorschach theory, 
to expect a relationship between M 
and FC and, for that matter, be- 
tween K, c, and C. 

Wittenborn’s findings were gener- 
ally confirmed in a study by Williams 
and Lawrence (8), who sought to rep- 
licate his study of psychiatric patients, 
drawing subjects from a different hos- 
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pital population. The clearest dupli- 
cation is in a “productivity” factor. It 
again shows high loadings for R, D, 
d, and F, though a few changes emerge 
in loadings for other scores. FC again 
shows a kinship with the movement 
scores, which in this study show joint- 
ly high loadings on a “movement” 
factor. A factor of low “perceptual 
control” again appears, with high 
loadings for c, CF, and C. A distinct 
intelligence factor also appears in the 
data of Williams and Lawrence, who 
included two Wechsler-Bellevue scores 
—Verbal IQ and Performance IQ—in 
their matrix. A fifth factor shows high 
loadings for Fc and FK. 

In a more recent study, Williams 
and Lawrence (9) have added MMPI 
variables to those used in the above 
study. Once again, there is a factor 
which is primarily a function of Ror. 
schach productivity. Of the remaining 
three factors extracted, two show an 
overlap of Rorschach and MMPI 
variables, while the other is primarily 
a function of certain MMPI variables 
alone. 


PROBLEM AND METHOD 


It has been noted that all previous 
factor analyses of Rorschach scores 
have found a productivity factor. This 
factor seems to be a necessary product 
of the experimental interdependence 
of certain scoring categories. R espe- 
cially may be expected to correlate 
spuriously with many other scores be- 
cause of the manner in which the 
scoring system has been constructed. 
The correlation of R with any loca- 
tion or determinant score is actually 
a part-whole correlation, since the 
sum of either the age determin- 
ant scores or of the location scores 
will equal R. Similarly, P and O are 
functions of protocol length, since 
their size is limited by the total num- 
ber of responses and longer protocols 
present more opportunity for popular 
and original responses to occur. On a 
similar basis, certain specific location 
and determinant scores may be ex- 
pected to correlate especially highly 


with R, so that even percentage scores 
will show certain systematic correla- 
tion effects. Such percentage scores 
are also unusable for factor analysis 
because of their ipsative nature. At 
any rate, the greater the protocol 
length in general, the greater the pro- 
portion of small and unusual details. 
For it is easier to give many responses 
if the subject feels free to use any part 
of the inkblot to the exclusion of the 
remainder for a given response. In- 
tegrating various parts of the blot in 
a single concept not only reduces the 
number of discrete responses to be 
tabulated but also alters the location 
scoring in the direction of W. The 
proportion of form-determined re- 
sponses will be a function of R for 
similar reasons, for an attempt to in- 
tegrate the various determinant po- 
tentialities of the blot will not only 
tend to produce a determinant scor- 
ing other than F but will also restrict 
the number of responses that a sub- 
ject can make. We may note, too, that 
the smaller the area to which a con- 
cept is confined, the less the possibility 
for a determinant scoring other than 
F. The derivation of determinant and 
location scores from the same set of 
responses is, of course, a source of 
spurious correlation in itself. This is 
not to deny that the joint occurrence 
of high R, high F%, and high d and 
DdY%, is devoid of psychological sig- 
nificance, for it is such an occurrence 
that one expects for certain types of 
subjects. The less common occurrence 
of high R with, say, high W% and a 
predominance of m responses, which 
is far less common because the nature 
of the test militates against the oc- 
currence, is likely to be of even great- 
er significance. 

For the present study, it was as- 
sumed that relatively little experi- 
mental interdependence should be 
present in a matrix composed entirely 
of determinant scores, since if only 
primary determinants are used, no re- 
sponse will contribute to more than 
one score. An experimental ingredi- 
ent tending to generate negative cor- 
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The far as a choice exists between two de- card will make any other possible re- 
i terminant possibilities in the produc- sponse less likely to occur. But this 
> for tion of a response or in the scoring of cannot be considered a serious source 
primary, as against secondary, determ- _ of interdependence. 
” on inants. For example, what is essen- On the other hand, individual dif- 
pod tially a form response (“two men” on ferences in total number of responses 
ae card III) may by a slight embellish- _ may be considered a source of positive 
pee ment, according to the whim of the correlations and may account in large 
— subject, become a movement response part for the generally positive trend 
oe (“two men lifting a piece of furni- seen in the correlation matrix (Table 
oan ture”). In the Klopfer scoring system, I). To the extent that the relative 
lit and generally in others as well, the size of certain determinant scores 
ated response will be scored M, though (considered as a proportion of the 
aaa form is theoretically the primary de- sum of determinant scores) varies sys- 
tego terminant. In terms of Rorschach  tematically with the total number of 
? theory, such experimental interde- responses, these scores will tend to 
a he pendence of determinant scores should correlate especially highly among 
lene not exist (to the extent that the num- themselves. If the relative size of each 
one ber of responses is not limited), for determinant score were a constant for 
a. scoring is ideally made in terms of all subjects and all protocol lengths, 
cat . the one process by which the percept of course, all determinant scores 
er is created (barring a simultaneous would correlate perfectly with one an- 
: arousal of engrams), and noembellish- other and with the total number of 
9 ment of the response should alter the responses in the protocol. Independ- 
hich primary determinant score assigned by ence of protocol length and relative 
pie an omniscient Rorschach examiner. size of specific determinant scores 
| The practical demands of scoring dic. would perhaps be the desired state of 
an. tate a somewhat different situation. affairs, for then all correlations be- 
' The experimental interdependence of tween determinant scores would be 
| determinant scores in the usual meth- equally, but only slightly spurious. 
das ods of administration is not so great Since this situation is not the expect- 
ard as it would be if a fixed limit were ed one, one might still expect some 
_be laced on the number of responses, sort of productivity factor with high 
rely but the set of the subject can be ex- loadings for scores systematically re- 
only pected to impose a sort of variable lated to protocol length. 
decal limit. Generally, the more responses a For the present study, the writer 
han subject has given to a card, the less sought a correlation matrix for Klop- 
edi- compulsion he may be expected to fer determinant scores for a group of 
_ have to give more. To this extent, the normal subjects. One of Wittenborn’s 











studies (11) provided the desired data 
The subjects were 92 Yale undergrad- 
uates. The intercorrelations, which 
are shown in Table I, were selected 
from Wittenborn’s matrix for the fol- 
lowing determinant scores: M, FM, m, 
K, FK, F, Fc, c, C’, FC, CF, and C. 
These correspond to the summary 
scores ordinarily entered on the de- 
terminant profile (thus, m includes 
mF and Fm, K includes KF, c includes 
cF, and C’ includes FC’ and C’F) and 
include all such categories except k, 
for which an adequate number of re- 
sponses was presumably lacking. 


Seven factors were extracted by the 
centroid method, with the resulting 
loadings shown in Table II. The jus- 
tification for extracting the seventh, 
and possibly the fifth and sixth as 
well, might be questioned, especially 
since a rather large r is needed for 
significance with a sample of only 92. 
All of the last three factors extracted, 
however, seemed to be of value in 
clearing up the factor structure, and 
all three gained variance in rotation. 
The fifth and sixth factors also seemed 
to become more meaningful in the 
course of rotation. The seventh, whose 
maximum loading is still only .31, re- 
mains rather ambiguous and may be 
considered a “residual” factor. The 
relatively small sample size, neverthe- 
less, seriously limits the conclusions 
that we can justifiably draw from the 
factors. But to date, inadequate sam- 
ples have been rather characteristic of 
factor analytic studies of Rorschach 
data. 
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The primary aim in rotation was to 
approximate simple structure. Posi- 
tive manifold was sought when other- 
wise indifferent choices presented 
themselves, though there are no com- 
pelling psychological reasons for de- 
nying bipolar factors in the present 
realm of data. An attempt was made 
to evaluate possible rotations in terms 
of their psychological meaning, but 
the writer did not seek to duplicate 
Wittenborn’s factors. He was guided 
rather by a general knowledge of the 
sorts of factors that had been found 
in several previous studies. Thus, 
there was some reason to expect fac- 
tors of intelligence, fantasy or intro- 
version, constriction, and neuroticism 
or low order of perceptual control. 


RESULTS 


An examination of Table III shows 
that positive manifold was virtually 
achieved for most of the factors. Only 
one negative loading, for CF on fac- 
tor III’, exceeds .20, and the loadings 
below this level may be regarded as 
not too significant. None of the ob- 
tained factors may properly be consid- 
ered a “productivity” factor, so that 
one may conclude that restricting the 
correlation matrix to determinant 
scores has eliminated much of the 
spurious correlation. The communal- 
ity for F is noticeably lower for the 
reduced matrix than it is for Witten- 
born’s matrix, as one might expect 
with the omission of R and the loca- 
tion scores. Of the determinants, F is 
the one that would have the highest 




































TABLE II—Centroid Factor Matrix 


I II Ill IV Vv VI VII h* 

2 == 58 41 21 —25 06 —08 —I17 66 
2 FM 50 19 23 09 -—22 —07 12 42 
Bsa vgasececrthstscaasacsuckcucnannesissvagsccasenese 66 14 20 $2 13 18 12 65 
o_O ON ATONE 60 —32 21 07 19 1k —I11 58 
RRR GR ore tere rs ee ceo eRe 43 —38 14 —06 —21 15 —18 44 
6 F 52 18 —16 —38 —17 05 11 51 
Te ac easa st cenccstcssasnocdaamaactncdscanessssveaban 72 29 —12 —I14 15 05 —05 66 
8 c 33 —37 ll —l1 17, —21 20 38 
Op secs teeshaiansh Spssscnasassesbatntoctc 65 31 —05 04 146 —ll1 —09 56 
| Ree eee ee one eet 58 39 —30 39 —07 20 06 78 
I seta ncnesnianacassstcesnareccctcvieatenaaiesnaceas 32 —4 —29 —04 08 24 09 47 
m ©€ $1 —37 —16 17, —ll —20 —10 35 




















nants RICHARD COAN 285 
as to TABLE III—Rotated Factor Matrix 
Posi- rv rrewF wy 
ther- 1 —0 43 60 2 . - . 
nted ; ~ 7 00 40 00 20 «65 
— t 57 «6 3838—“‘( BK! Kk HCC 
r de- 5 55 416 18 —17 18 02 44 
esent 6 07 00 54 05 = i a 
= is rn rn 
— 9 03 2 3 4 +18 02 56 
but 10 10 16 02 44 —16 09 78 
icate 11 55 —26 02 14 12 25 46 
ided 12 30 —08 —06 02 44 —05 35 
f the 
und loading in a fluency or productivity the light of Rorschach theory, might 
‘hus, factor, and it has a loading above .50 be specifically termed an “anxiety” 
fac- only on factor IV’, to which such a_ factor. Anxiety would be reflected 
1tro- meaning cannot readily be attributed. here in an evasion of the manifest 
cism Factor I’ has only one high loading, form potentialities of the blot. Diffuse 
1. for FC, and the remaining loadings shading responses (K) become prom- 
above .30 are distributed among an_ inent. Where form is mentioned, it is 
assortment of variables — FM, m, F, likely to be vague and indefinite in 
— Fc, and C’. Any attempt to define this character, suggesting feeble attempts 
lly factor at present seems hazardous. It to reconcile the form of the concept 
nly resembles a factor referred to by Wit- with that of the blot. Factor VI’ sug- 
re tenborn as one of intelligence or orig- gests a low order of perceptual con- 
ings inality in having a high loading for trol that is more a function of uncon- 
. a FC. But such an interpretation seems _ trolled emotional response to the en- 
- unwarranted in view of the relatively vironment. The sensitivity to texture 
ory low loading for M. It also resembles suggested by c would seem to counter- 
that Wittenborn’s productivity factor, des- indicate an evasion of manifest char- 
he pite a loading for F of only .35. This acteristics of the blot. The picture is 
‘ates factor may, however, be largely a func- rather that of a tendency to submit 
che tion of variables which tend to ac- passively to emotional impulses ar- 
ny company length of protocol for sub- oused by environmental forces with- 
the jects in the population studied. out taking active measures to control 
ait _ Factor II’ more closely resembles a them. The emotionally stimulating 
oul factor which Wittenborn felt to in- characteristics of the blot thus absorb 
ia volve a “low order of perceptual con- the subject’s attention, and form 
F is trol.” As in the case of Wittenborn’s _ tends to be disregarded. 
son factor, the loadings for K, KF, and CF Factor III’ resembles factors that 
are highest, and there are positive have been spoken of in terms of intel- 
loadings for m, c, and C as might be _ ligence, originality, fantasy, and intro- 
predicted. A further distinction, how- version. It differs slightly from any of 
h* ever, is suggested by the presence of Wittenborn’s factors in having three 
66 factor VI’, which has high loadings prominent loadings for the three 
= for c and C and lower ones for K, FK, movement variables, though it accords 
58 and CF, This resembles another factor with a factor found by Williams and 
44 of Wittenborn to which he did not Lawrence (8). It may be interpreted 
51 attempt to assign a definite interpreta- as an intratensive factor, such as might 
4 tion. Both factors II’ and VI’ would _ be predicted on the basis of the Ror- 
56 seem to involve a low order of percep- schach rationale for the movement 
78 tual control, with slightly different responses. It seems to reflect a gen- 
= manifestations of it arising from fac- eral sensitivity to “inner stimuli,” 


torially distinct sources. Factor II’, in 


which thus exert an influence on the 
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perception of external stimuli. 


M has further variance which ap- 
pears on factor IV’, where it is coupled 
with F and Fc, M, F, and Fe are all 
variables which have been associated 
with some sort of perceptual control, 
but the zero loading for FC counter- 
indicates an interpretation of a “gen- 
eral perceptual control” factor. The 
emphasis is rather on M, which may 
represent an “inner control.” Taking 
the loadings for F and Fc into account, 
we might interpret the factor as one 
having to do with the constructive 
use of inner stimuli, or creativity. An- 
other possibility is suggested by Klop- 
fer’s interpretation of texture respons- 
es in terms of a “need for contact.” 
It may be that the high loading for M 
on factor IV’ is attributable to the 
prevalence of human content in M 
responses. M and Fc in combination 
might reflect a sort of responsiveness 
to people which we could designate as 
empathy. We might use this term 
simply in the now popular sense of 
social responsiveness or integrate the 
idea with a kinesthetic concept of em- 
pathy, perhaps adopting Schachtel’s 
(6) physiological rationale for the 
movement response. 


Among the variables with high load- 
ings on factor V’, Fc is accompanied 
by C’ and FC, This factor differs from 
VI’ in having nearly zero loadings for 
c and C. It may thus represent a con- 
trasting factor of controlled emotion- 
ality. Control in this case would be 
effected by well regulated emotional 
responses, reflected in the integration 
of color and texture with form, rather 
than by withdrawal or emotional con- 
striction. There is little point in at- 
tempting to interpret factor VII’, on 
which there are but two loadings as 
high as .30, these being for F and c. 
The remaining loadings are scattered 
among FM, m, Fc, and CF. It would 
be difficult to find a meaningful inter- 
pretation for a factor having a little 
variance on each of these particular 
variables, Factor VII’ may be viewed 
as a residual factor. 


A Factor Analysis of Rorschach Determinants 


SUMMARY 


1. A factor analysis by the centroid 
method was performed on the matrix 
formed by the intercorrelations of 
twelve determinant scores selected 
from data provided in a previously 
published scudy of Wittenborn. The 
subjects of Wittenborn’s study were 
92 Yale undergraduates. 

2. Seven factors were obtained, and 
rotation was attempted in the direc- 
tion of simple structure. 

3. A distinct productivity factor, 
such as has appeared in all previous 
factor analyses of the Rorschach is 
not evident, though factor I’ may pos- 
sibly have some significance of this 
sort. The lowered relative commun- 
ality of F, in the present data as 
against Wittenborn’s data, is interpret- 
ed as a consequence of the elimination 
of the most spurious correlations from 
the matrix. 

4. Factors II’ and VI’ are interpreted 
as factors of low perceptual control, 
involving anxiety and passive submis- 
sion to emotional impulses respective- 
ly, Factor III’ is taken as evidence of 
an intratensive factor, involving a 
general sensitivity to inner stimuli. In- 
terpretations of factor IV’ are sug- 
gested in terms of “inner control” and 
empathy, while factor V’ seems to in- 
volve an “outer control” or a con- 
trolled emotional responsiveness to 
the environment. The variance of fac- 
tor VII’ is probably in large part re- 
sidual. 
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Rorschach Productivity and Card Preferences as Influenced by 
Experimental Variation of Color and Shading’ 


Harry M. Grayson 
VA Neuropsychiatric Hospital, Los Angeles 


This investigation introduces a new 
Rorschach research tool, one expressly 
designed to permit experimental in- 
vestigation of various assumptions and 
hypotheses relating personality struc- 
ture with responsiveness to color and 
shading. The tool is comprised of a 
total of nine achromatic and mono- 
chromatic sets of Rorschach cards, 
plus the original Rorschach, making 
up ten sets of 100 cards in all. Three 
sets are entirely achromatic, differing 
from each other only in degree of 
blackness. The range of blackness- 
intensity from the lightest to the dark- 
est set is not great, although easily 
perceptible. The reason for the rela- 
tively narrow range of blackness is to 
avoid loss of shading-detail as the 
printing becomes either too light or 
too dark. The other six are mono- 
chromatic sets in the following colors: 
blue, green, yellow, orange-tan, brick, 
and red. These colors were selected as 
being most nearly like the colors on 
the original Rorschach chromatic 
cards. The sets were made by means 
of the Kodak Dye-Transfer process, 
the printing being done in mono- 
chrome colored dyes.2 The idea of 





* The writer wishes to express his apprecia- 
tion and thanks to Mr. W. L. Martinsen, 
Chief of the Medical Illustrations Labora- 
tory, V.A. Center, Los Angeles, for working 
out the technical procedures and making the 
entire series of Rorschach variations; and to 
Professor J. A. Gengerelli for invaluable as- 
sistance in connection with the statistical 
analyses of the data. 


*In making these prints the first step is to 
make normal black and white negatives. As 
in any photographic process, from these 
negatives a matrix is prepared which is a 
gelatine image film base. The image is in 
relief form so that the parts to be printed 
darkest in color are the thickest parts of the 
relief with the medium or in-between tones 
in somewhat lower relief. There is no gela- 


constructing multi-colored sets of 
cards was put aside for the time being 
because of the technical difficulties 
presented. If the results obtained in 
experiments with the present series 
are sufficiently promising to warrant 
it, multichrome Rorschach variations 
may be constructed. 


Problems 


Although the present study was un- 
dertaken primarily to investigate the 
effect of experimental variation of 
color and shading on Rorschach card 
preference and productivity, the ex- 
perimental design provided answers 
to the following questions: 

1. Is Rorschach productivity, in 
terms of the number of responses 
elicited, significantly influenced by: 

a. variations in color and shading, 

irrespective of form? 

b. form, or card design, irrespec- 

tive of color? 

c. subject, or person, irrespective of 

form, color and shading? 

d. interaction effects among color 

and shading, form and subject? 

2. Is the pleasantness or preference 
value assigned to the cards signifi- 
cantly influenced by the variables in- 
dicated above? 

3. Is there a relationship between 
pleasantness of the card and number 
of responses it elicits? 





tine present where no image is to be printed. 
The matrices are used much in the same 
manner as the photoengraver uses his metal 
plates to print from. A transfer of the image 
consists of soaking the matrix in the ap- 
propriate dye and then squeeging the matrix 
onto a specially prepared transfer paper. The 
image then consists of a heavy deposit of 
dye where the matrix relief was the thickest 
with proportionally less dye transfer as the 
relief was lowered. 
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Experimental Design 


The subjects of the experiment were 
thirty Rorschach-naive female college 
students, mostly nurses, who were tak- 
ing an undergradutae psychology 
course with the UCLA University Ex- 
tension. In order to facilitate the ex- 
periment, the students were seated in 
three rows, running ten seats across. 
Each student had a Harrower-Erick- 
son booklet in which she entered and 
numbered the responses to each card. 
The use of the booklet was explained, 
and the customary instructions given. 
In addition, the students were re- 
quested to assign a pleasantness value 
on a five-point scale, ranging from 
minus 2 (very unpleasant) to plus 2 
(very pleasant) to each card. 


The ten cards were distributed to 
each student in the standard sequence 
for card design, but order of color 
and shading was randomized accord- 
ing to a 10 x 10 Latin Square design 
(Chart I) which appeared on the 
blackboard in front of the class. From 
the Chart it can be seen that Subject 1 
received Card I in the original Ror- 
schach set (A); Card II in dark black 
(B); Card III in blue (C), etc. Sub- 
ject 2 received Card I in dark black 
(B); Card II in brick (G); etc. (The 
colors corresponding to the code let- 
ters are given in Tables I and II.) 


Since the back of each card was 
coded to correspond to the Latin 
Square design, each student in the 
first row was able to receive the ap- 
propriate cards in proper order. Four 
proctors assisted in distributing the 


CuHart I. 

Subject I II Ill IV 
eee A B Cc D 
Oa B G A E 
| ERT C H J G 
-_ a ROO ACO D A G I 
ae E F H J 
_ ETON F E B Cc 
ae ee G I F B 
__ ee H Cc I F 
ick nhac I J D A 

Sa J D E H 
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cards to the students in the first row. 
The students had three minutes time 
for each card and turned the card 
face down to signify that they had 
finished. Most finished well within the 
three minutes. Those few who lagged 
behind were reminded to finish up 
after two and three-fourths minutes, 
and were allowed to finish even if 
they exceeded the time limit. 

On the face of each card, at top 
center, was a small circle in pencil to 
show how the card was to be held. 
Those students who asked if they 
might turn the cards were informed 
that they could do so. At the end of 
three minutes, the students in the 
first row passed their cards directly to 
the students behind them, face down. 
They then asked for their next card 
by code number, These were handed 
to them by the proctors, face down. 
When all the cards were in proper 
place the signal to proceed was given. 
The students in the first row all be- 
gan on Card II, those in the second 
row on Card I. This same procedure 
was followed until the students in the 
third (last) row had completed all ten 
cards. (It should be noted that the 
procedure involved a triple replica- 
tion of the experimental design.) 
Upon completing the performance 
proper, the students went back and 
indicated the locations for their re- 
sponses on the small black diagrams 
printed in the Harrower-Erickson 
booklets. They also indicated for each 
card whether the responses had been 
primarily influenced by shape, color, 
movement, or texture. 


Latin Square Design of Experiment 


Card Sequence 


Vv VI Vit Vil Ix Xx 
E F G H I J 

H Cc F I J D 
F B E A D I 

J E C B F H 
I G A D B Cc 
D I J G H A 
A D H J c E 
G J D E A B 
Cc H B F E G 
B A I Cc G F 
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Taste III. Analysis of Variance Based on Productivity 
Source of Variation d.f. S.S. M. Square F 
| RS RE Ac Se ee ee Tee: 299 - 1191.00 

Interaction between persons and cards 

within a series 180 172.60 .96 
POVOOUMS WEEE B SETECS. <q... -.-n-ceccsescnsseescsen 20 654.50 32.72 34.00** 
(| EL e e PR AE \5 RA LLM LIS CLACTON TE ee 9 26.70 2.97 3.09** 
Colors BAe Roe eR a ee ee ten 9 6.00 67 
ROR Olan ee RO oe ESTE 81 331.20 4.09 4.26** 


** Significant at beyond the .01 level. 
Statistical Treatment 


Since each of the 30 subjects re- 
ceived a complete set of ten color- 
randomized cards, there were 300 
stimulus card presentations. Each pre- 
sentation yielded content responses 
and a pleasantness rating. The num- 
ber of responses and the pleasantness 
rating of each subject were separately 
entered in the appropriate cell of a 
Latin Square design and treated by 
analysis of variance.* Tables I and II 
provide the card-by-color data for pro- 
ductivity, and for pleasantness, re- 
spectively. 

The sums of squares of the 300 ob- 
servations constituting the experiment 
were divided as follows: (a) Inter- 
action between persons and cards 
within a color series, This sum of 
Squares was used as basis for the error 
term, since the values involved may 
be looked upon as a random sample 
of a normally distributed variable. 
(b) Individual differences within a 
color series; (c) Cards; (d) Colors; 
(e) Interaction between cards and 
colors. 

This mode of breakdown was fol- 
lowed both as regards the produc- 
tivity variable and the pleasantness- 
unpleasantness rating. In the former 
we deal with the number of responses 
per card; in the latter, with a judg- 
ment on a 5-point scale relative to 
the affect evoked by a card, Whether 
the data gathered in the present ex- 
periment fulfill the requirements of 
normality is a moot question, since 
we have no evidence that Rorschach 
responses constitute a normal univ- 


* All determinants, ratios, etc., can be an- 
alyzed similarly by entering the desired 
data in the appropriate cells. 


erse; this judgment is perhaps even 
more pertinent with respect to the 
ratings. Nonetheless, the findings of 
Norton (5) relative to the influence of 
deviations from normality and homo- 
scedasticity on the values of F ratios, 
justify in some measure, at least, the 
use of the analysis of variance tech- 
nique in this case. Both the produc- 
tivity data and the rating scale data 
met the homogeneity of variance re- 
quirements. 


Results 


Productivity, Table III presents the 
analysis of variance based on produc- 
tivity as defined in terms of the num- 
ber of separate responses elicited. 

As is to be expected, individual dif- 
ferences in productivity, even within a 
color series, give the largest source of 
variation. The individual Rorschach 
cards, regardless of color, also con- 
stitute a significant source of varia- 
tion. (As will be noted in Table IV, 
our subjects gave the greatest number 
of responses to Card X, and the least, 
to Card VII. This is in consonance 
with clinical experience.) The inter- 
action between forms and colors is 
also significant in influencing produc- 
tivity but the colors alone, interest- 
ingly enough, are not. 

Since productivity was found to be 
influenced significantly by card de- 
sign, it was thought of interest to see 
which cards elicited most and which 
elicited least responses. The rank or- 
der of card productivity is presented 
in Table IV. 


As might have been expected, Card 
X, with its relatively discrete large- 
detail areas, elicited the greatest num- 
ber of responses entirely irrespective 
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TABLE IV. Rank Orders of Card 
Productivity 


Total Responses 





Rank (N = 30 cases) 
1 121 
20 104 
1 98 
S 97 
6 96 
75 86 
9 85 
10 79 


of color. In fact, in our data, Card X 
yielded a higher average number of 
responses on the achromatic series 
than on the chromatic series, although 
the partial confounding resulting 
from the experimental design make 
comparisons of the effects of chro- 
matic versus achromatic series ques- 
tionable. The same finding, it might 
be added, obtained for some of the 
other cards, especially cards IV, VI, 
and VII. On the other hand, cards I, 
III, and especially IX produced more 
responses on the chromatic series. But 
since these data are partially con- 
founded by various improperly ran- 
domized interaction effects, they are 
presented as something which might 
be explored further, rather than as 
substantiated findings. At any rate, to 
get back to Table IV, Card X pro- 
duced the greatest number of re- 
sponses, followed by III and IX which 
were tied for second place. Card VII 
elicited the least number of responses, 
followed closely by IV, V and VI, It 
should be kept in mind that, although 
the cards which were variations of the 
standard chromatic cards in general 
produced most responses, whereas the 
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cards which were variations of the 
standard achromatic cards produced 
the least responses, it was not the 
presence or absence of color which 
determined this, Since each card ap- 
peared in each of the ten chromatic 
and achromatic versions, it was the 
design of the card irrespective of color 
and shading which influenced the 
number of responses. However, as 
Table III showed, although color per 
se is not significant, the interaction 
effect of color and card design is sig- 
nificant at a level beyond that of card 
design alone. 

Pleasantness. Table V presents the 
analysis of variance based on affec- 
tivity ratings on a five-point scale. 

It is notable that the only clearly 
significant source of variation in af- 
fectivity ratings was color. (This, per- 
haps, is consonant with our expecta- 
tions derived from ordinary experi- 
ence. As will be noted in Table VI, 
the best liked color series is the stand- 
ard Rorschach and the least liked is 
the light black set.) Forms barely 
missed significance at the .05 level. 
Perhaps the most startling thing from 
a psychological point of view is the 
lack of significance of individual dif- 
ferences within a color series in in- 
fluencing affectivity ratings. 

Since pleasantness was found to be 
influenced significantly by color and 
shading irrespective of card design, it 
is of interest to see the rank order of 
pleasantness ascribed to the various 
chromatic and achromatic series. This 
is shown in Table VI. 

Here it is clear that multiple colors, 
such as appear on the original Ror- 


TaBLe V. Analysis of Variance Based on Affectivity Ratings 


Source of Variation 


Interaction between persons and cards 
cn ik. et EERE CREE STOO cer OT ROE 


Persons within a series..... 
Forme.......... ORR Oe 
ee oe ce Re a 

NN os ed aca 


* F = 1.93 at the .05 level. 
** Significant at beyond the .01 level. 






d.f. SS. M. Square F 
299 460.92 
180 245.67 1.36 
20 38.78 1.94 1.43 
9 23.33 2.59 1.90* 
9 42.67 4.74 3.86** 
81 140.89 1.74 1.28 
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the Taste VI. Rank Orders of Color Pleasantness 
uced Total Pleasantness Value 
the (N = 30 cases) 
hich Color Set Rank (Possible range: minus 60 to plus 60 
ap- Original Rorschach....... 1 +20* 
latic EEE EEE Penner me +9 
Green +6 
| the Orange-Tan 0 
olor | Brick 0 
the Yellow —2 
. as ARETE ccna SR Pe RC arene cor ere aul} 
er EEA LOLA ON ORT 8 —10 
I Black (dark) 9 —15 
tion Black (light) 10 21 
= * Although the experimental design did not Dee sufficient randomization to permit ade- 
ard quate statistical analysis of any single set individually, it is interesting to note that the sums 


of the pleasantness values for the chromatic cards (II, II, VIII, IX, X) and the achromatic 
the cards (1, IV, V, VI, VII) on the standard Rorschach set were +19 and +1, respectively. The 


ffec- average pleasantness score for cards II and III was +2, that for cards VIII, IX, X was +5. 
It therefore seems quite evident that it was the multichrome colors of the standard Rorschach 

e. , set which determined the high pleasantness value ascribed to it. 
arly 

af- schach chromatic cards, are most pre- cards appeared also in all of the mono- 
_— ferred. After that come the cooler col- chromatic variations, Apparently the 
— ors, blue and green. The warmer col- designs themselves are not liked, per- 
pf ors, (orange-tan, brick, yellow, red) haps because of the fearful father 

I, are responded to in a neutral fashion. image, and the sexuality, associated 
ind- But even the warm colored cards are respectively with these two cards. Card 
i is preferred to the achromatic cards, X when stripped of the advantage of 
rely which are rated as actually unpleasant. its multiple colorfulness by being com- 
vel. Might we say that most of us prefer pared with all other cards in all of 
ean life to be colorful, even if at times it the variations, fared not too well, with 
the may become uncomfortably warm, to a pleasantness ranking of third from 
dif- leading a dark, drab, or colorless ex- last. The disparateness or lack of co- 
eal istence? hesiveness of the card design is the 
be Since card design barely misses sig- likely reason for this low ranking. 
er nificance at the five per cent level, it Card II, — the clowns or cuddly 
fe may be of interest to see how the cards bears, was the most preferred card. 
’ of ranked in terms of preference or Perhaps because the effects of color 
Sh pleasantness. The data are given in and shading were completely neutral- 
ee Table VII. ized in the analysis above, so that the 
his Card IV was the least liked card, pleasantness values are ascribable to 
mms, | with Card VI coming next, even Ortpcrences is quite different from that 
or- though these originally achromatic Fit lined by Mildred B. Mitchell (4). 





TABLE VII. Rank Orders of Card- 
Form Pleasantness 





Her subjects were asked to select the 
card liked best and the card liked 
least. The non-patients in her study 


Total (most comparable to our group of 

Pleasantness students) ranked the “liked best” 

ara cards as follows: X, IX, III, VIII, VI, 

té I-II, IV-V-VII. They ranked the “liked 

. 43 least” cards, beginning with the most 
** +1 disliked, as follows: VII, IV, I-II-III, 
7 V, VI, X, VIII, IX. It is interesting 

10 that the three multicolored cards (X, 

—14 IX, VIII) occupy the first, second, and 
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fourth rank, among the “best liked” 
cards, with Card III, another colored 
card, occupying the third rank. Cards 
IV, V, and VII, all achromatic cards, 
are tied for last rank, Contrariwise, 
among the “least liked” cards, Cards 
VII and IV, both achromatic cards, 
are the most disliked, while Cards IX, 
VIII and X, all multi-chromatic cards, 
are the least disliked. This is in gen- 
eral agreement with the finding of the 
present study when card-form is neu- 
tralized, that multi-chrome colors rank 
as the most preferred, monochrome 
colors rank next, and achromatic col- 
ors rank last. It is also in agreement 
with the findings of Wallen (6) who 
compared expressed liking for the 
original Rorschach cards and for pho- 
tographed achromatic reproductions 
of these cards. He states that, for his 
normal group, “The significant de- 
crease in the popularity of the last 
three cards when they are achromatic 
demonstrates the pleasantly stimulat- 
ing effect of the multicolored blots.” 

Relationship between pleasantness 
and productivity. Since variation in 
color and shading were found to in- 
fluence pleasantness rating significant- 
ly but not to affect productivity, it 
would seem unlikely that any rela- 
tionship between pleasantness and 
productivity exists. ‘This lack of rela- 
tionship was substantiated by the 
data. Two rank-order correlations 
(Spearman rho’s) were computed be- 
tween productivity and pleasantness, 
each involving ten paired rankings. 
One involved the correlation between 


rank order of productivity and of 
pleasantness, by color; the other in- 
volved the correlation between rank 
order of productivity and of pleasant- 
ness, by card design. (See Table 
VIII.) 

The respective rho’s of +.34 and 
+.29 (corrected for tied ranks) when 
tested by a ¢ transformation as de- 
scribed by Kendall (3) are not sig- 
nificantly above chance, indicating a 
lack of any relationship between 
pleasantness ascribed to the card and 
productivity elicited by it. 


Discussion 


Perhaps it should be emphasized 
that the findings obtained in this 
study are pertinent only to the kind 
of population and conditions used in 
this experiment. In a “normal” group, 
absence of color shock might be anti- 
cipated, so that productivity on chro- 
matic and achromatic cards might 
reasonably be expected to be similar 
(as was the case in the present ex- 
periment). An experiment specifically 
designed for this purpose by Allen (1) 
clearly establishes this as a fact. This 
might, however, not be the case in a 
psychiatric population. In addition, 
reaction time for first response to each 
card might be a more sensitive meas- 
ure of color and shading disturbance 
than is the number of responses pro- 
duced over a three-minute period, al- 
though another study by Allen (2) 
failed to reveal any significant differ- 
ence in reaction time of normal col- 
lege students to comparable chro- 


Taste VIII. Rank Order of Productivity and Pleasantness By Color 
and By Card Design 


Rank Order 
Color Productivity Pleasantness 
Orange-Tan....... 
a 
Light Black........ 
| 


Original............... 
Medium Black... 


4.5 

3 
10 

4.5 

2 

1 

8 

9 

6 

7 


Cw MATE OOOO n= 


Vs) 
oe 

Qa 
— 


Rho = 4.34 


Rank Order 
Card Design Productivity Pleasantness 
X I 8 
Ill = 3 
IX 2.5 4.5 
I 4 1.5 
II 5 1 
Vill 6 6.5 
© 15 a 
VI 75 9 
iv 9 10 
Vil 10 6.5 


Rho = +-.29 
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matic and achromatic cards. However, 
repetition of this experiment on psy- 
chiatric patients, utilizing reaction 
time in addition to number of re- 
sponses would seem to be worth doing 
and might clarify the meaning of 
color and shading disturbance. A fur- 
ther refinement would be to admin- 
ister, for example, a standard, a red, 
and a blue Rorschach set to a group 
of individuals and to compare the 
differences in performance on these 
by various nosological groups, e.g., 
hysterics, schizophrenics, etc. Perhaps 
the use of more than one set, or the 
insertion of particular colored or 
black and white cards during the in- 

uiry or testing-the-limits phase, might 
ka the diagnostic focus. It would 
also make an interesting and _pos- 
sibly revealing research project to 
analyze various differentiating per- 
sonality characteristics between the 
“form--bound” individual who would 
give practically identical perform- 
ances on the achromatic and the vari- 
ous chromatic series, and the “color- 
responsive” individual whose _per- 
formance on the achromatic and the 
chromatic, and indeed, on the dif- 
ferent chromatic versions, would be 
quite decidedly different. 


Summary 


This study introduces a new re- 
search tool for investigating hypo- 
theses involving relationships between 
personality structure and responsive- 
ness to color and shading. This tool 
consists of ten different Rorschach 
sets or series (100 cards) comprising 
the following: an original Rorschach 
set; three achromatic sets differing in 
blackness-intensity; and six mono 
chromatic sets running the rainbow 
gamut from blue through red, The 
study reported here was an investiga- 
tion utilizing this tool to ascertain the 
effects of experimental variation in 
color and shading on Rorschach card 
preferences and productivity among 
a group of presumably normal, Ror- 
schach-naive nurses. The experimental 
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design permitted ascertaining the ef 
fects of card design, design-color ir 
teraction, and individual differences 
in influencing card preferences and 
productivity; and it also provided an 
opportunity to determine whether 
there was any significant relationship 
between productivity and _pleasant- 
ness ascribed to the card. The follow- 
ing findings emerged: 

1. Productivity is independent of 
color and shading; is significantly in- 
fluenced by card design; is even more 
significantly influenced by design- 
color interaction; is most emphatically 
affected by individual differences. 


2. Card preference, on the other 
hand, is significantly influenced by 
color and shading; barely fails to be 
significantly influenced by card de- 
sign; is not influenced significantly by 
design-color interaction; and is least 
affected by* individual differences 
among the persons, or subjects, of the 
experiment. 


3. There is no significant relation- 
ship between card preference and pro- 
ductivity. 

Some limitations of the present 
study, and some additional research 
suggestions were mentioned. The ease 
with which the new Rorschach re- 
search tool lent itself to the present 
study suggests that it is a promising 
instrument for further research into 
the relationship between personality 
variables and responsiveness to color 
and shading. 
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The Negation TAT; a Projective Method for Eliciting 
Repressed Thought Content *’” 


RICHARD M. JONEs 
Harvard Psychological Clinic, Cambridge, Mass. 


INTRODUCTION 


This investigation had as its aim 
the evaluation of a modified form of 
TAT administration, founded on the 
thought mechanism of negation as 
formulated by Freud, and as discussed 
by Rapaport. 

The concept “negation” appears 
first in Freud’s paper, “The Uncon- 
scious” (1, p. 119): 

There is in this system no negation, no 
dubiety, no varying degree of certainty; all 
this is only imparted by the work of the 
censorship which exists between the Ucs 
and Pcs. Negation is, at a high level, a sub- 
stitute for repression. In the Ucs there 
are only contents more or less strongly 
cathected. 

The following statement, quoted 
from Freud’s paper, “Negation” (2, 
p. 182), constitutes the fundamental 
proposition upon which this study is 
based: 

Thus the subject-matter of a repressed 
image can make its way into consciousness 
on condition that it is negated. Negation 
is a way of taking account of what is re- 
pressed; indeed it is actually a removal of 
the repression, though not, of course, an 
acceptance of what is repressed. 

From these considerations we learn 
in clinical practice to be attuned to 
spontaneously negated associations as 





* Reviewed in the Veterans Administration, 
and published with the approval of the 
Chief Medical Director. The statements and 
conclusions published are the result of the 
author’s own study, and do not necessarily 
reflect the opinion or policy of the Veterans 
Administration. 

* This study was conducted at the Boston 
VA Mental Hygiene Unit. The author is 
indebted to Dr. J. Warren Thiesen, Chief 
Clinical Psychologist, and other members of 
the clinic staff for their helpful advice and 
suggestions, and in particular to Dr. Charles 
Storey, Dr. Lazarus Secunda, Dr. Stewart 
Smith, and Dr. William Shelton, who par- 
ticipated as therapist-raters. 


brief reflections of an individual's ego- 
alien psychic content. However, as 
regards turning this mechanism to use 
in standard projective testing, we are 
faced with the question of whether 
clinically evoked negation shares the 
properties of spontaneous negation. 
An observation drawn from Freud's 
experiences as a psychotherapist is 
relevant to this question. He states (2, 
p- 181): “There is a most convenient 
method by which one can sometimes 
obtain a necessary light upon a piece 
of unconscious and repressed mate- 
rial. ‘What,’ one asks, ‘would you con- 
sider was about the most unlikely 
thing in the world in this situation’?” 
Rapaport is more explicit (3, p. 339): 
“The aim of this question is to create 
the same psychological situation as the 
one which prevails when a negation 
enema arises. It attempts to 
arouse forces that would negate the 
drive-representation as soon as it 
rises to consciousness, and thereby to 
obviate the danger of its being acted 
on, which is the reason for repressing 
it ... [It] clearly illustrates that nega- 
tion is a significant aspect of the 
thought process. It shows how com- 
munication can play a dynamic role 
in thought organization: the question 
permits a loosening of repression by 
preparing the ground for negation.” 
The present research attempts to 
evaluate systematically the clinical val- 
idity of evoked negated associations, It 
thus seeks to bring empirical evidence 
to bear upon the above formulations. 


As a projective method, the nega- 
tion approach had its initial trial 
somewhat accidentally in a particular- 
ly difficult testing situation. A few 
days after having read Freud’s paper 
on negation the author was engaged 
in administering the TAT to a psy- 
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chotic patient. The patient’s typical 
response to every picture ran some- 
thing like: “That man has heavy 
thinking. He’s in deep thought. There 
are lots of worries and there’s pressure 
over here. Everything is darkness.” To 
such responses the examiner would in- 
quire: “What kind of thinking? What 
might the thoughts be? What is he 
worrying about? What is in the dark- 
ness?” etc. The patient’s response to 
this type of inquiry ran monotonously 
as follows: “Oh, don’t ask me that! 
I can’t answer that: You mustn’t ask 
me that kind!” On the last card 
(18BM), after the patient had re- 
sponded in his usual manner, the ex- 
aminer asked, somewhat in exaspera- 
tion: “What is the one thing that 
could not be happening in this pic- 
ture?” The patient’s immediate re- 
sponse was: “He wouldn’t fight back. 
He couldn’t do that. He has eaten too 
much and he is too fat from living a 
bad life. He couldn’t fight back.” This 
was the only response in the entire 
TAT protocol in which there ap- 
peared any identifiable content. 

The clinical utility of this device, 
as employed by the writer, has since 
proved impressive. TAT stories in re- 
sponse to the standard instructions 
present the usual representative pic- 
ture of the individual’s characteristic 
defenses, with inferential cues (almost 
always highly disguised by the censor- 
ing processes) concerning the unique 
forms taken by his unconscious im- 
agery. The negated counterparts of 
these stories have tended, with en- 
couraging regularity to reveal in 
naively undisguised forms the fanta- 
sies, images, and wishes, which would 
appear to be the objects of repres- 
sion. It is as if the individual, thus 
encouraged to shift responsibility for 
his own associations onto the exam- 
iner and his instructions, seizes this 
as a brief opportunity to give relative- 
ly uncensored expression to his re- 
pressed desires. 

The negation instructions have 
been found to be most productive 
with normal subjects, and with pa- 


tients who yield extremely guarded 
material in response to the standard 
instructions despite the establishment 
of a good patient-examiner working 
relationship. On purely impressionis- 
tic grounds the writer has come to 
view responses to the negation instruc- 
tions in three categories: (1) The in- 
dividual accepts the instructions im- 
mediately and naively, seeming al- 
most grateful to the examiner for 
coming up with this helpful new twist 
and proceeds to weave a fantasy of 
strikingly uncensored quality. (2) The 
individual “sees through” the instruc- 
tions, usually remarking that this is 
ridiculous because anything could not 
be there. Then, under the examiner’s 
pressure he tries to concoct something 
utterly fantastic, as if to prove his 
point. This type of response shares 
the disguise features of the standard 
TAT story. However, the symbolism 
employed seems much more thinly 
veiled and amenable to much more 
confident inferences on the part of 
the interpreter. For example, one pa- 
tient who suffered from extreme feel- 
ings of sexual inadequacy, after re- 
marking that anything he said would 
be meaningless “because anything 
could not be there,” responded to 
Card 13 as follows: “Well, all right, 
then you could say that he’s not rid- 
ing a motorcycle, because he could 
never handle a motorcycle. And _ be- 
sides, motorcycles make his wife sick. 
That’s not in the picture!” (3) The 
third category refers to a small minor- 
ity of individuals who seem not to 
comprehend the instructions. For ex- 
ample: “I couldn't do it.” ““That’s too 
hard for me.” “It doesn’t make any 
sense.” 

The writer’s experience with the 
negation device has not been suffici- 
ently extensive to note any consistent 
parallels between these categories and 
accepted nosological groupings. The- 
oretically, one would expect person- 
alities of “hysteric” structural empha- 
sis to populate the first category and 
personalities of “obsessive-compulsive”’ 
structural emphasis to populate the 
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second category. A different line of re- 
search from that pursued here will be 
needed to explore this question. 

As it was employed in this study 
the modified administration of the 
TAT involved very simply asking the 
subject to make up the most unlikely 
story that came to mind for each pic- 
ture—after the entire standard set of 
stories had been collected. To reverse 
this order, experience had shown, was 
to undermine the projective “set” in- 
tended by the standard instructions. 
After giving negated responses the 
subjects’ reactions to the standard in- 
structions seemed dominated by a con- 
viction that there was a correct story 
(an observation, in itself, worth not- 
ing, in respect to the reality testing 
function attributed to negation in 
psychoanalytic theories of thinking.) 
The exact phrasing of the negation in- 
structions varied with the intelligence 
and types of resistance shown by the 
subjects. For example: “What is the 
most unlikely theme this picture 
might represent?” “What is the last 
thing in the world that this picture 
might bring to mind?” “What could 
not be going on here?” 


PROCEDURE 


1. A five card TAT (8BM, 13MF, 
14, 17BM, 18BM) was administered 
under two sets of conditions to eleven 
patients in psychoanalytically oriented 
psychotherapy at the Boston VA Men- 
tal Hygiene Clinic. All patients had 
been in continuous treatment with the 
same therapist for at least six months 
prior to testing. The two sets of con- 
ditions were: 

(1) Standard (Murray) instructions. 

(2) Negation instructions. 

2. The protocols were recorded ver- 
batim on tape. 

3. The negation protocols were edit- 
ed to eliminate references to the ne- 
gation instructions, thus eliminating 
an obvious source of possible bias in 
the rating of the stories. 

4. Typed transcripts of the paired 
protocols were codified and their re- 
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spective positions on the rating sheets 
randomized. 

5. “Blind” comparative ratings of 
each pair of stories were made by 
each patient’s own therapist, answer- 
ing the question: “Which story of 
each pair more lucidly suggests this 
patient’s repressed psychic content, as 
you know it?’’s 


In order that you may more clearly > 
preciate your role in the research let us fill 
you in on some of its background. We think 
we have discovered a new way of administer- 
ing the TAT which tends to elicit repressed 
material in much less disguised forms than 
does the standard method of administration, 
and we are out to prove it. We do not think 
the new procedure is better, generally, than 
the old—only that it yields something dif- 
ferent which is clinically valuable: namely, 
the direct expression of the kind of re- 
pressed content which is only vaguely if at 
all alluded to in other testing procedures. 
Thus, the specificity of our question. 

The concept “repressed psychic content,” 
then, is the key concept in our research, and 
this is where you come in. The concept of 
“repression,” because of the looseness of its 
referential boundaries raises serious ob- 
stacles for any scientific research in which it 
is involved. Imagine, for example, the dif- 
ficulty that all of the psychoanalytically 
oriented therapists involved in this study 
would have in trying to agree precisely on 
an explicit definition of “repressed psychic 
content.” However, we assume that a com- 
mon denominator of reference exists, which, 
though perhaps undefinable at present, al- 
lows each of you to communicate in mean- 
ingful ways with one another about your 
patients. Now, since we do not consider it 
to be the purpose of this research to define 
the concept of repression, but only to critic- 
ally evaluate two testing procedures, we are 
skirting the whole problem of definition by 
leaving it up to you who are in the best 
position to know what’s what, definition or 
no. Thus, we are claiming for our purpose 
that “repressed psychic content,” in any 
particular patient, is what his therapist says 
it is. In other words, we are asking you to 
fill the role of expert whose judgments we 
shall use as criteria in evaluating our hypo- 
thesis. That is why we are not telling you 
in advance what the new procedure con- 
sists of or which story is which, We are pre- 
dicting on the strength of our hypothesis 





3 Therapist-rater Instructions: In rating the 
imaginative productions of each of your pa- 
tients you are asked to answer one specific 
question: Which story of each pair of stories 
more lucidly suggests repressed ‘psychic con- 
tent in this patient? 
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how you will judge them on their own 
merits, and according to how accurate our 
predictions are, to that extent we shall con- 
sider the hypothesis valid. 

Remember, we are interested only in your 
answer to a very specific question: not which 
set of stories “tells more about” the patient; 
not which gives more information about 
“control mechanisms,” or “ego strength,” 
or “phase of therapy,” etc.; only which set 
of stories lucidly suggests repressed psychic 
content. 

Four psychoanalytically trained psy- 
chiatrists cooperated in the study as 
therapist-raters. They were provided 
with the pertinent TAT pictures and 
copies of their patients’ recorded pro- 
ductions. Precautions were taken to 
prevent the therapist’s knowing what 
the “new” TAT instructions were. 
This was doubly insured by the edit- 
ing of the negated stories. The rat- 
ings were, therefore, presumably 
made only on the bases of the con- 
tent of the stories in relation to the 
pictures themselves and each thera- 
pist’s own intimate knowledge of his 
patient. 


RESULTS 


In 46 of the 55 pairs of TAT stories 
the negation story was rated more 
lucidly suggestive of repressed psychic 
content. This differential is statistical- 
ly significant at greater than the .001 
level of confidence, using the sign 
test (5). 

The following examples serve to 
convey some of the clinical flavor of 
these findings: 


Patient A: TAT card 8 BM 
Standard story: 


An operation. A father is laying down 
on a cot, his son is, his son can’t face the 
realities of life, is afraid that his dad may 
die. Surgeons are going about their busi- 
ness in a methodical way. The patient, I 
believe he is under anesthesia; he’s not 
having any anguish in his face at all; just 
poor light. Could be, could be war; could 
be possibly during the blitz, I should say, 
and they don’t have any emergency hos- 
pital. They are doing surgery right there, 
right in the room. The room is somewhat 
demolished. The window is on an angle. 
The boy is well dressed though; that’s the 
strange part about it. The doctors are 


dressed . . . they have their white uniforms 
on, There’s a rifle there. Could be fifth 
columnists, underground. This boy is 
young. Why would he be dressed, that’s 
the question? Since everything else looks 
demolished. There’s a rifle; shining in the 
sunlight. (Outcome?) Well, we all hope 
for the best. Like myself, going back to 
myself, I hope these treatments I’ve been 
receiving from Dr. Smith. Oh Christ, God, 
I don’t know! As far as this picture here, 
I hope it ends up for the best. 

Negation story (rated more suggestive of 
repressed material): 


He’s going to have a baby. Maybe we 
go back to Christmas at Devil Island when 
the convicts would hide these tubes, or 
vials, or whatever you want to call them, 
up their rectum, They kept their valuables 
in them. But then again he’s not on his 
back, on his stomach. The doctors could 
be, say, mercenary, and they are trying to 
take out his money. He had a money belt 
sewed on his stomach. 


Patient B: TAT card 8 BM 


Standard story: 


Well, it looks as though there had been 
some sort of an accident here, down in the 
foreground. I don’t know. I can’t seem to 
compose enough of a story from it. (An 
accident, you say?) Yeah, it looks as though 
it’s symbolic. of an accident or an illness. 
Is this a weapon, do you know? (Whatever 
comes to mind.) It looks like a weapon and 
it looks as though they are operating on 
an emergency. The condition being a gun- 
shot wound, and perhaps the climax... 
Either that is a female or a male person 
being operated on. Apparently there is a 
loss of life as a result of the accident, and 
the picture of the boy on the foreground 
shows perhaps the loss of a parent, if 
there was a parent, or kinfolk. That’s all 
I can see. (Outcome?) I don’t know. It’s 
just one of, it looks like the thing, no, 
ended in sorrow for the child. 


Negation story (rated more suggestive of 
repressed material): 

This would remind me of this young 
boy, for example leaving the table and this 
man here would be his father and he is 
sawing or cutting through a large steak 
which he is about to eat. The other per- 
son would be at the table, the young man 
would be eating, so that it would be sym- 
bolic of that, I should think. Help him 
to eat. 


Patient C: TAT card 18 BM 
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Standard story: 

This guy is stiff. Somebody is taking 
him some place. His hands look too del- 
icate. They’re cops. Maybe it’s not even a 
person. Maybe it’s something spiritual. He’s 
all dressed up so he’s not a bum. He’s got 
drunk for some reason, maybe to forget 
whatever problem he may have. Now he’s 
. . . tomorrow morning he will wake up 
and he will be o.k. 

Negation story (rated more suggestive of 
repressed material): 

This guy is laying there and contracts 
(sic) for so long, and this woman here is 
chasing him, is holding him up, making 
him keep on going through the steps, fol- 
low the routine. He is disgusted with her. 
He wants to go to sleep. 


Normal Subject: TAT Card 14 
Standard story: 

This is a boy. He was asleep in his bed 
at night and he heard the noise of jets 
overhead. And he jumped out of his bed 
and ran to the window to see the blue ex- 
haust of flames of the planes shooting 
through the sky. And it thrilled him. And 
he decided that when he was of sufficient 
age he was going to join the air force and 
perhaps fly a jet. And hestruggled through 
school. He graduates high school and joins 
the army. He’s physically accepted to fly; 
learns to fly and distinguishes himself in 
air battle. He comes home a hero. 
Negation story: 

Well, this is a boy. It’s a very dark 
room. It’s a laboratory. He’s working in a 
laboratory. It’s a dark room. And he’s a 
photographer. He’s studying photography. 
And he just finished making a composite 
picture of his father in bed with another 
woman. And he just finishes processing it. 
And it’s come out very successful. And he’s 
standing at the window thinking how he’s 
going to show it to his mother and wreck 
his mother’s marriage. 


DISCUSSION 


The results would clearly seem to 
justify further explorations into the 
clinical and research utility of , the 
negation approach, and it is hoped 
that this report will be a stimulant to 
such research. Particularly enlighten- 
ing would be a study designed to 
evaluate the efficacy of this approach 
in eliciting clinically relevant and 
distinguishing material, i.e., material 
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that permits of distinguishing between 
individuals on the basis of specifically 
important repressed psychic content. 
It is suggested that more exhaustive 
validation research in this direction 
will lead to a more thorough-going 
assessment of the practical clinical 
value of the Negation TAT. 

Insofar as the results are supported 
by further validational research they 
support the position taken by Wyatt 
(4) that the standard TAT story is a 
product of a confluence of waking ego 
functions brought to bear upon un- 
conscious strivings; that the latter are 
rarely revealed in uncensored forms 
in the TAT production; and that 
more caution should therefore be ex- 
ercised in imputing “unconsciousness” 
to the actual expressions of the stand- 
ard TAT story. Wyatt states: “In the 
light of the experiences of psychoan- 
alytic therapy, the process which pro- 
duces responses to the TAT seems to 
be much more one of defense and 
elaborate safeguarding against dan- 
gerous promptings than their frank 
fulfillment.” 

The need for interpretive caution 
must, of course, hold for the negation 
TAT story as well, since negation is, 
itself, an ego mechanism. The results 
of this study, however, while support- 
ing Wyatt, with respect to the stand- 
ard TAT story, suggest that the ne- 
gation TAT story is much less sub- 
ject to the elaborate censoring activi- 
ties that characterize the standard 
TAT story, highlighting instead the 
very content that we assume is being 
censored in the standard story. Thus, 
the negation approach is not to be 
considered a substitute for the stand- 
ard approach in diagnostic work, but 
rather a complementary approach 
that can aid in the interpretive proc- 
ess, at that step in the process where 
aid is now most needed, i.e., in the 
identification of specific unconscious 
content. 


Indications for Further Research. 


This study has emphasized the clin- 
ical utility of the negation approach 








302 The Negation TAT and Repressed Thought Content 


in conjunction with the projective 
approach. In view, however, of the 
theoretical properties attributed to 
the negation mechanism by the psy- 
choanalytic theory of thinking, and in 
view of the experimental properties 
shown by this study to adhere to the 
negation approach, the approach it- 
self may make its principal contribu- 
tion as an experimental tool in gen- 
eral psychoanalytical research. 

From the point of view of the psy- 
choanalytic theory of thinking, nega- 
tion is a variety of conscious experi- 
ence. As such, it is closely inter-related 
with the function of judgment. More 
specifically, in the meta-psychological 
language of the theory, it is one of 
the controlling organizational ego 
functions involved in reality testing. 
Still more specifically, negation 1s 
conceived as a thought mechanism 
(related to but not to be confused 
with “defense mechanism”, e.g., de- 
nial) through whose agency ego-dys- 
tonic material can circumvent the va- 
rious censorships, under the guise of 
disbelieved conscious experience, in 
support of ego syntonic aims. 

It would seem, then, that the nega- 
tion mechanism operates as one of the 
agents of that experimentally elusive 
fluidity that is conceived to exist be- 
tween the primary and secondary sys- 
tems of thought organization, In 
Rapaport’s terms (3, p. 343): “Nega- 
tion appears to be a re-representation 
of repression on a higher level of in- 
tegration.” 

It is noteworthy that in consider- 
ing the theoretical position of the 
negation mechanism the focus of our 
interest has shifted pointedly from 
the identification of unconscious con- 
tent, pathologically organized, to the 
understanding of normal, creative or- 
ganizational processes. It is in this 
latter area, where research efforts suf- 
fer from a paucity of natural and 
controllable experimental tools, that 
the negation approach may make its 
most strategic contribution. 

To date, in general psychology, re- 
search efforts in understanding the 


nature of “thought” have dealt al- 
most exclusively with secondary proc- 
ess thinking, as may be witnessed, for 
example, in the long list of “concept 
formation” studies, ‘There have been 
relatively few systematic efforts to 
study the primary process, and still 
fewer have attempted to investigate 
the assumed processes of fluid inter- 
action between the two. This is un- 
derstandable in view of the relative 
inaccessability of primary process ma- 
terial to observation during normal 
waking life. Indeed, since observations 
of the psychoanalytic method itself 
are not subject to traditional experi- 
mental controls, we have had to rely 
almost entirely upon the reported 
dream, the hypnotic state, and various 
states of narcotism as the tools of sys- 
tematic research in this area. 

Certainly, the negation approach 
will be found to have its limitations. 
Before these are discovered, however, 
it may well prove in its research con- 
tribution to be, like the free associa- 
tion method itself, a simple and pro- 
ductive investigative wedge into the 
resistant processes of dynamic mental 
functioning, and this while permitting 
of experimentally controlled observa- 
tion during directed normal waking 
activities. 


SUMMARY 


This study sought to make a pre- 
liminary evaluation of a modified 
form of TAT administration founded 
on the thought mechanism of nega- 
tion. After the standard TAT stories 
have been collected the subject is 
asked to report for each picture the 
most unlikely story that comes to 
mind. The clinical utility of this de- 
vice, as employed by the writer, has 
proved impressive in eliciting naively 
undisguised psychic content. The 
present study was designed to test 
these impressions. 

Eleven patients in psychoanalytical- 
ly oriented psychotherapy were ad- 
ministered a 5 card TAT, first with 
the standard instructions and then 
with the negation instructions. 
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“Blind” comparative ratings of each 
pair of stories were made by each pa- 
tient’s own therapist answering the 
question: “Which story of each pair 
more lucidly suggests this patient’s re- 
pressed psychic content as you know 
it?” In 46 of 55 pairs of stories the 
negation story was rated more lucidly 
suggestive of repressed psychic con- 
tent. This differential is statistically 
significant at greater than the .001 
level of confidence, Concrete examples 
were presented. 

The study lends support to the po- 
sition that the standard TAT story 
does not reveal uncensored “uncon- 
scious” content so much as it reveals 
the machinations of the censorship 
surrounding this content. 

The results would appear to justify 
further explorations into the clinical 
and research utility of the negation 
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approach. In view of the theoretical 
properties attributed to the negation 
mechanism it may prove to be peculi- 
arly adapted to the study of the trans- 
itional dynamics between the primary 
and the secondary systems of thought 
organization. 
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Increments and Consistency of Performance 
in Four Repeated Rorschach Administrations 


BERT KAPLAN AND STANLEY BERGER 
University of Kansas 


In work with the Rorschach, inter- 
pretations are almost always based on 
a single test administration. The as- 
sumption is made that only in his ini- 
tial and spontaneous reactions does 
the subject select responses which op- 
timally reveal his personality and that 
these responses, with a few additions, 
constitute the entire universe of psy- 
chologically meaningful or interest- 
ing responses. The basis for this as- 
sumption undoubtedly lies in the 
theory that perception of the Ror- 
schach blots is selective and that what 
is initially selected is of special signifi- 
cance. In the present paper, we will 
take the position that this selective 
process continues well beyond the per- 
ceptions which are ordinarily report- 
ed on a first administration of the 
Rorschach and that the development 
of a technique for eliciting large num- 
bers of additional perceptions is of 
psychological interest. 


A number of considerations lead 
us to question whether it is wise to 
put all our eggs in the basket of a 
single administration of the Ror- 
schach test. Experience in psychother- 
apy and in personality study indicates 
that very often patients are unwilling 
or unable to express their major con- 
cerns and preoccupations on an ini- 
tial contact and only very gradually, 
after many sessions, do they become 
freely expressive. We suggest that 
many of the instances in which the 
Rorschach “does not test” as Lowell 
Kelly has put it, or does so in a dis- 
appointingly sparse way, are cases of 
this kind of initial reticence or inhi- 
bition rather than “emotional impov- 
erishment,” “shallowness,” or “insuffi- 
cient differentiation.” 


In this connection, a host of recent 
studies, such as those by Lord (7), 


Kimble (5), Klatskin (6), Eichler (1), 
Gibby (2) and Hutt and his col- 
leagues (3) indicate that the circum- 
stances surrounding the administra- 
tion of the test have a considerable 
influence on the nature of the re- 
sponses. This influence is not super- 
ficial but affects the most basic aspects 
of the performance. If test results de- 
rive in part from the specific situation 
in which the subject finds himself at 
a particular moment, we may draw 
the conclusion that any one test per- 
formance can hardly tell the whole 
story since in other situations the sub- 
ject might appear to be quite differ- 
ent. 

The most convincing argument 
against the complete reliance of the 
Rorschach worker on a single per- 
formance lies in the astonishing com- 
plexity of personality. As clinicians, 
sensitive to this fact, we expect that 
even when an interview or test pro- 
cedure yields apparently profound in- 
sights into personality, subsequent in- 
formation will broaden the picture 
and modify our impressions. This 
process seems to go on as long as we 
continue to study the subject and we 
literally never achieve a final or true 
formulation. Work at the Harvard 
Psychological Clinic with the TAT 
has shown that only part of the po- 
tential of the subject is tapped by the 
20 pictures in the test and that with 
repeated administrations of the TAT 
or with additional testing of the story 
telling variety, important additional 
material can be obtained which not 
only expands our picture of the sub- 
ject, but often sharply alters any for- 
mulation based on the first adminis- 
tration. 


Retest studies of Rorschach per- 
formance usually reveal a great deal of 





— 


a i al i a ac i i A A 


(1), 
col- 
um- 
stra- 
able 
re- 
per- 
ects 
de- 
‘ion 
f at 
raw 
per- 
iole 
ub- 
Ter- 


‘ue 
ird 
\T 
0- 
he 
ith 
x 
ry 
jal 
ot 
ib- 





BERT KAPLAN AND STANLEY BERGER 


similarity in responses from one ad- 
ministration to another, Even when 
there have been drastic intervening 
conditions, the stability of perceptions 
is remarkable. We believe that this 
stability is a function of the dom- 
inance of what has already been seen 
and that perceptual organizations 
once achieved tend, under certain con- 
ditions, to interfere with the emerg- 
ence of new ones. The conditions we 
have in mind exist when the old per- 
ceptions are in competition with po- 
tential new ones. This is the case in 
the usual retest situation. If we ask 
why the old perceptual organizations 
do not interfere with new ones during 
the course of a single test we can say 
that a response which has already 
been given does not compete with 
new ones which are emerging since 
only the new responses satisfy the de- 
mands of the test situation. The older 
responses are no longer of value in 
terms of the immediate needs of the 
subject and thus lose their compelling 
and dominating force. 

Since we were, in the present study, 
interested in seeing whether substan- 
tial numbers of additional responses 
could be produced, this analysis of- 
fered a clue to the appropriate meth- 
od for eliciting them. This was simply, 
on the second and subsequent admin- 
istrations, to ask the subject to report 
only new perceptions and to omit any- 
thing he had given earlier, This in- 
struction we hoped would remove the 
dominating and inhibiting influence 
of what had already been seen. 

Using the instruction to report only 
new and different responses, the Ror- 
schach was administered four times. 
We had the following questions in 
mind: (1) Can subjects produce a sub- 
stantial number of responses in addi- 
tion to the ones given on a first per- 
formance? (2) Do these new responses, 
if forthcoming, add significantly to 
the personality picture derived from 
a first performance? (3) Are the new 
responses, if forthcoming, substantial- 
ly similar to the ones given on a first 
performance in terms both of content 
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and scoring categories? We believed 
that the answers to these questions 
would have certain implications for 
Rorschach practice and theory, for 
the question of the reliability of the 
test and would yield new insights into 
the correlates of Rorschach produc- 
tivity, a subject dear to the heart of 
anyone who has given three 15 re- 
sponse Rorschachs in succession. 


PROCEDURES 


The subjects in this study were 28 
college students who were volunteers 
from an _ introductory psychology 
course at the University of Kansas. 
The group Rorschach was adminis- 
tered four times, using the Harrower- 
Erickson slides which were projected 
on a screen and exposed for a minute 
and a half in the regular position and 
a minute and a half in an inverted 
position. On the second, third and 
fourth administrations, the subjects 
were told to give only new and differ- 
ent responses. The protocols were sub- 
sequently examined and a very small 
number of responses which we judged 
to be duplicates were eliminated. The 
time interval between the tests was 4 
days. A special effort was made to 
create and maintain a friendly and 
relaxed atmosphere and high group 
morale throughout the experiment, A 
fifth session was held in which an in- 

uiry was conducted, and a sixth ses- 
sion was held in which the subjects 
filled out a questionnaire asking for 
certain attitudes and feelings with re- 
spect to the test experience, The ex- 
periment was also explained and dis- 
cussed during this session. It is of in- 
terest that all 28 of the subjects who 
started continued in the experiment 
until the last session which was op- 
tional. 


RESULTS 


Table I presents the mean scores 
for 17 Rorschach variables on each of 
the four administrations. It may be 
seen that productivity as measured by 
R fell off about a third on the second 
administration, but maintained itself 
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Tase I. Mean Score of 28 Subjects 
In 4 Repeated Rorschach 
Administrations 


Test Test Test Test 
I II Ill IV 


34.8 23.9 21.0 23.7 





72 54 45 4.1 
ei 38 Si 3: 
8 3 = 4 
os 3 a = 
19 89 79 8.6 
S4 17 5 
16 15 9 414 
5 3 23 235 
1.2 9 5 4 
$9 25 235 46 
1s 22 19 9 
178 94 74 12 
14.7 129 96 8.7 
= 4 A A 
25 26 $3 2% 


at the same level on the third and 
fourth. To our question as to 
whether subjects can produce sub- 
stantial numbers of new responses, we 
can answer in the affirmative since 
subjects who gave an average of 34 re- 
sponses originally, produced an aver- 
age of 68.6 new responses on the three 
later performances. These results also 
strongly suggest that this is not the 
outer limit of productivity but that a 
fifth and sixth administration would 
bring even more responses. Informal 
experiments with as many as nine ad- 
ministrations have revealed there is a 
gradual decrease both in number and 
quality. 

Table II presents Kendall’s coeffi- 
cient of concordance, a non-paramet- 
ric test of consistency of rank, for 13 
Rorschach variables. It may be seen 
that twelve are significant at the .01 
level and one at the .02 level. These 
findings indicate that there is a sig- 
nificant degree of stability in the 
scores on the location and determin- 
ant categories over the four perform- 
ances. We should mention that these 
scores were in the form of percentages 
rather than numbers of responses, so 
that we were working with M%, 
FC%,etc. This means that the fact 
that individuals tended to hold their 
ranks in all four performances was 
not a function of differences in the 


TABLE II. Kendall’s Coefficient of 

Concordance, W, Showing Stability 

of Ranks on 13 Rorschach Variables 

of 28 Subjects in 4 Administrations 
of the Rorschach Test 



































Variable —" P 
__ EE Le ee Ce meee 49 01 
M pa —— 01 
FM+m 48 01 
yeas crasrcccectaroscssiece icescrensneats 50 01 
FC A2 01 
Nai aseate acnaecxiccactakarenesthocnonancoas 40 01 
M:sum C 37 02 
ee as ee ae 65 01 
SEE EN ee eens 50 01 
SN a aT 52 01 
Sum c* 48 01 
M:sum C* 42 01 
R* 64 01 





*On the starred measures, “W” is based 
upon actual frequencies of responses. For 
those which are not starred, the scores were 
converted to percentages. 


number of responses. These findings 
do not, however, resolve adequately 
the question of whether the responses 
in each of the four performances are 
distributed in the same way among 
the determinant and location cate- 
gories. The significant Ws indicates 
that a similarity does indeed exist but 
a — remains as to the magni- 
tude of the similarity and it is difficult 
to translate the size of the Ws into 
such terms, 

The product-moment correlation 
provides an index of similarity of re- 
lationship between sets of scores. 
Table III presents the correlations be- 
tween tests 1 and 2, 1 and 3, and 1 
and 4 of scores on 13 variables. Corre- 
lations are given both for scores con- 
verted to percentages as in MY and 
for scores reflecting simple frequencies 
as in number of M responses. Of the 
43 correlations computed, 17 are sig- 
nificant at the .01 level and 3 others 
are significant at the .05 level. R, FM, 
and M, and the location categories 
tend to show the greatest amount of 
consistency. The Rs, taken as a group, 
indicate that there is a considerable 
amount of relationship between per- 
formance | and subsequent perform- 
ances. However, the coefficients of 
alienation indicate that only a rela- 
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TaBLeE III. Product Moment Correlations of Rorschach Scores of 28 Subjects 
In 4 Repeated Administrations. 


























1 and 2 1 and 3 1 and 4 
Test Freq. % Freq. % Freq. % 
R 129° 56** 64** 
M 07 51% Al* a7 33 06 
I scans ca sscac on sxsensnssasacoesadancass AQ** 4l* .60** 57** 54** 53¢¢ 
54** 36 ag 
FC .30 28 38 41* 13 37 
Sum C > ae 32 .20 21 —.04 .20 
M:Sum C. 16 53** 22 
Eee eee er eee en .15%* 10%* A9** 
eee 67** 46 62% 
0 SNS a eee 54** 47 08 





* Significant at the .05 level. 
** Significant at the .01 level. 


tively small part of the variance is 
accounted for by these correlations. 
The highest correlation, .75 for W% 
between tests 1 and 2 accounts for 
52%, of the variance while an R of .51 
accounts for only 27% of the variance. 
The findings indicate therefore that 
there has also been a considerable 
amount of change. These changes were 
large enough so that the basic shape 
of the psychogram showed relatively 
little stability. Using only percentages 
of movement, form and Sum C res- 
ponses it was found that when the 
patterns formed by these scores were 
compared for tests 1 and 2, | and 3, 
and | and 4 for the 28 subjects sep- 
arately, on only 18% of the pairs was 
the pattern the same so that for 
example, F% was still highest, M% 
second and Sum C% lowest. 


Perhaps the most interesting data in 
this study have to do with the chang- 
ing content of responses in the four 
administrations. Unfortunately space 
does not permit our going into this in 
more than a cursory way. In order 
that the reader get some idea of the 
concrete situation, however, we have 
presented the responses of one subject. 
No claim is made that she is absolutely 
typical or representative since reac- 
tions varied a good deal in different 
subjects. However we can say that this 
kind of sequence of responses is in no 
way unusual. The subject is female 
and aged 1°. The responses are to 
Card I. Inquiry is omitted. 


Test 1. 
1 — Bat 
2 — Air Shield 
3 — Cliffs 


v4—A water fountain as in a park 
5—A Chinese tower, place for cars to 
drive under 
Test 2. 
1 — Hands reaching out 
2—Top—an explosion with fragments 


flying 
v3—Small animals in center casting spell 
downward 
Test 3. 
1—Two large birds resembling people 
fighting 


2—Two tiny figures like elves right in 
center, each has an arm up over his 
head 

3— Egyptian or Chinese lady with full 
sleeves and tall hat in center 

Test 4. 

1 — Two winged chiefs over a conference 

table 
v 2— Masses of molten lava 


In this example new responses ap- 
pear on tests two, three and four 
which not only lend themselves to new 
content interpretations but were not 
suggested by anything which came 
before. This is absolutely character- 
istic and occurred in every one of the 
28 subjects. 


DISCUSSION 


What are the implications of these 
findings? The fact that these subjects 
have been able to produce large num- 
bers of additional responses is, we 
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believe, of considerable significance. It 
suggests to us that the very great indi- 
vidual differences in Rorschach pro- 
ductivity which constitute one of the 
most notable of Rorschach phenom- 
ena, do not stem from basic differ- 
ences in capacity but are dependent 
instead on motivation and set and are 
to a considerable extent subject to 
manipulation. This is a very large 
jump from our results especially since 
our subjects were college students, a 
group noted for its high productivity. 
It would therefore be very nice to 
have this experiment repeated with 
other classes of subjects including 
that recalcitrant group of psychoneu- 
rotic patients who ordinarily average 
around twelve responses, Such experi- 
ments are planned for the near future. 
However, we do not feel that the cor- 
rectness of our conclusion is really de- 
pendent on the results of these addi- 
tional studies. Neurotic subjects in a 
hospital setting will undoubtedly be 
less responsive to our wishes than were 
the college students, but we would be 
very reluctant to believe that really 
basic differences exist. To get more 
responses from the former one would 
simply have to develop an appropriate 
test setting in which compliance with 
the tester’s instructions satisfies the 
subject’s needs in some genuine way. 
We do not mean to assert that intelli- 
gence is not related to the capacity 
to produce large numbers of responses 
but we think that subjects within the 
normal range have a much larger 
Rorschach potential than is ordinarily 
sampled by a first performance. Indi- 
vidual differences in capacity may exist 
at a much higher level so that some 
people may be able to produce as 
many as three or four hundred res- 
ponses before quality declines and 
they are unable to go on while others 
may be able to give only 75 to 100 
responses. Our point is not that diff- 
erences in capacity do not exist but 
that the number of responses given on 
a first performance is a poor measure 
of capacity. 

Since a first Rorschach administra- 


tion ordinarily samples a good deal 
less than the total Rorschach potential 
we may ask whether it adequately rep- 
resents the larger universe of res- 
ponses. Our findings are not clear on 
this point. On the one hand they indi- 
cate a definite similarity between the 
first and the second, third and fourth 
performances. On the other hand 
there is a considerable amount of 
change and the basic shape of the 
psychograms tend to be — variable. 
The size of the correlations when 
judged by the standards against which 
we ordinarily measure reliability are 
uite low. However, there is a ques- 
tion as to whether these standards are 
appropriate in this situation. 


While we entertained the possibility 
that the correlations might be very 
high and would have regarded this as 
convincing evidence of one aspect of 
the reliability of the test, namely per- 
former consistency, our own expecta- 
tions were that they would not be 
high since we took the position that 
only some aspects of the subject’s per- 
sonality would be expressed on a first 
test and that others would be ex- 
pressed on subsequent performances. 
Our findings indicate that this expec- 
tation was correct. Nevertheless the 
amount of stability is considerable 
and may be regarded as evidence that 
the Rorschach test does tap some func- 
tions of personality which express 
themselves in a consistent way. 


The demonstration that subjects 
can produce substantial numbers of 
additional responses inevitably raises 
the question of why they ordinarily 
stop so far short of their capacity. One 
possibility which we seriously enter- 
tained was that subjects become psy- 
chically fatigued or satiated and are 
actually unable to continue. Certainly 
some subjects act very much like brain 
injured patients in their inability to 
shift and reorganize the blot stimulus 
despite apparently strong efforts to 
do so. However, these appearances 
may be deceptive and further research 
is needed to determine whether actual 
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incapacity or motivation and set are 
the crucial factors. 


In conclusion, these results suggest 
that a certain degree of caution is ap- 
propriate in interpreting a single Ror- 
schach performance. Such interpreta- 
tions should be made in the light of 
the findings, presented in this study, 
that the responses obtained are only 
part of the story, and that they are 
tied to the peculiar circumstances 
under which the test was given. We 
interpret our data as demonstrating in 
conclusive fashion what many other 
Rorschach studies have implied; name- 
ly, that the single Rorschach perform- 
ance cannot be regarded as an ade- 
quate, stable or complete representa- 
tion of the personality characteristics 
which the Rorschach is able to des- 
cribe. 
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The Inter-examiner Reliability of the Rorschach Test 


EpituH S. LisAnsky! 
Yale University 


INTRODUCTION 


Reliability has several aspects: 

1. Self-consistency of the subject. Is 
the pattern of Rorschach responses 
given by an individual stable or does 
it vary and what are the conditions 
under which it varies? 

2. Self-consistency of the examiner. 
To what extent will a given Ror- 
schacher agree with his own scoring, 
his own interpretation? 

3. Consistency among examiners in 
scoring and interpretation. Given the 
same protocol, will independent Ror- 
schach workers score and interpret it 
in the same way? 

We are here concerned with the last, 
the inter-examiner reliability of scor- 
ing and interpretation. The scoring 
of the Rorschach test yields readily 
enough to statistical study but Ror- 
schach interpretations are usually 
clinical reports, i.e. they are verbal 
accounts about character structure, 
interplay of traits, behavior, prognosis, 
etc. As such, they vary depending on 
the individual interpreter’s theoretical 
frame of reference in psychology, his 
talent and insight and verbal ability 
and the immediate use to which a 
clinical report needs to be put. The 
individual interpreter’s definition and 
use of many terms like anxiety, adjust- 
ment, identification vary. These verb- 
al accounts, while frequently mean- 
ingful and useful in a clinic situation, 
are almost impossible to equate from 
one examiner to the next with any 
degree of certitude and exactness. To 
minimize this problem, a question- 
naire was used. 





1 Based on a dissertation submitted to the 
Department of Psychology of Yale Univer- 
sity in partial fulfillment of the Ph.D. re- 
quirements. The writer would like to ex- 
press appreciation toward Professor Irvin 
L. Child who has been helpful and en- 
couraging. 


Studies of the inter-Rorschacher re- 
liability of interpretation have been 
reported for a single case (5), with 
problem children (6) and with adol- 
escents (3). The reliability of Ror- 
schach “signs” has been examined in 
several studies (2, 8). There are re- 
ports of scoring reliability (1, 4, 9, 10), 
surprisingly few considering the rela- 
tive ease with which inter-examiner 
agreement on scoring can be checked. 
In general, agreement on scoring and 
on the presence or absence of certain 
Rorschach “signs” is good. Reports on 
the reliability of interpretation are 
few and ambiguous. Most of the re- 
liability studies of scoring, “signs” or 
interpretation, have involved Ror- 
schach workers who are working to- 
gether, usually in a clinic situation. 


PROCEDURE 


This is, in a sense, two duplicate 
experiments with the data of each ex- 
periment combined. Forty Rorschach 
protocols were randomly divided into 
two groups, twenty in each. Six Ror- 
schachers were randomly assigned: A, 
B and C received the same 20 proto- 
cols (set ABC) and D, E and F re- 
ceived the other 20 protocols (set 
DEF). 

The Rorschachers 


The six Rorschach workers aver- 
aged 10.5 years of general experience 
in clinical psychology and 8 years of 
work with the Rorschach test. All have 
published research articles involving 
Rorschach data and all have taught 
the Rorschach technique. 


The Rorschach protocols 


The 40 protocols were all adminis- 
tered by the writer at a voluntary out- 
patient clinic for alcoholics, the Yale 
Plan Clinic. The subjects included 29 
men and 11 women and mean age was 
41.8 years with a range from 25 to 57 
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years. Mean educational level was the 
12.3 grade. Thirteen subjects were 
white collar workers, 12 worked in 
professions or as executives, 11 worked 
at mechanical trades and there were 3 
housewives and | college student in 
the group. Twenty-nine patients were 
married, three single and eight either 
divorced or separated from husband 
or wife. The 40 patients have in com- 
mon a symptom, i.e. chronic alcohol- 
ism, and their presence at a clinic for 
diagnostic or psychotherapeutic help. 
All were tested early in their clinic 
contact. The patients represent a wide 
range of psychopathology (as alcohol- 
ics do), The Rorschach —= were 
randomly chosen from the test file, the 
only selective factor being the size of 
the protocol. Only protocols with at 
least 15 but not more than 60 respons- 
es were used. The average number of 
Rorschach responses of the 40 proto- 
cals was 26.5. 


The Questionnaire 


A preliminary survey was made in 
which six Rorschachers were asked to 
list the main parts of a Rorschach in- 
terpretation and to check behavior 
items they felt confident predicting 
from the Rorschach. From this survey, 
a ten item questionnaire was devised. 
Wording the questions presented a 
problem: most Rorschach workers 
agree that Rorschach test data cannot 


predict behavior in highly specific sit- . 


uations; at the same time, questions 
need to be concrete in order to minim- 
ize ambiguity. The number of alter- 
native answers depended on the ques- 
tion. On the first nine items of the 
questionnaire, the interpreter selected. 
one out of three to five choices but it 
was not possible to so limit the ques- 
tion about the patient’s outstanding 
symptom or diagnostic feature. The 
questions posed were: 
1. What is this person’s intellectual ca- 
pacity? 
2. To what extent is this individual using 
his capacities? 
3. Is this person ambitious, i.e. to what 
extent is the drive to achieve or ac- 
complish present, to what extent does 
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he actively strive to reach goals of in- 
tellectual, social or occupational suc- 
cess? 

4. To what extent is this individual rigid 
or flexible in adjusting himself to the 
changing demands of most life situa- 
tions? In other words, is he in a rut or 
to what extent can he change his be- 
havior to fit a changed situation, e.g. 
how does he react to his job when a 
new supervisor is introduced or new 
work requirements set up? 

5. How would you characterize this per- 
son’s work habits, ie. how do you think 
he handles problems related to his job, 
to intellectual tasks? 

6. In a social situation and everyday con- 

tacts with people, how would you ex- 

pect this person to act, e.g. at a party 
or alumni gathering, bowling, meeting 
business contacts, etc.? 

How much emotional control does this 

person exhibit in stress situations, e.g. 

first clinic contact, loss of a job, being 

left by his wife, etc.? 

8. To what extent is this individual sen- 
sitive to and responsive to the needs of 
others, e.g. in love relationships, family 
relationships, friendships? 

9. How would you evaluate this person’s 
sexual adjustment, i.e. the degree to 
which he anticipates and receives pleas- 
ure from sexual intercourse? 

10. Outstanding symptom or diagnostic 
feature? 


~J 


Rorschach factors relevant to each 
questionnaire item 


Before the protocols were sent, each 
Rorschacher was sent a copy of the 
questionnaire with the following in- 
structions: 

Please list under each question those 
Rorschach factors which you feel must be 
considered in answering each question. We 
are aware that in making an interpretation 
on some specific point, several Rorschach 
elements are evaluated together and in the 
context of the whole record. What we 
would like to know is what these elements 
are, i.e. which Rorschach factors are to be 
considered in answering these questions of 
interpretation? 


The life history abstract 

“Blind” interpretations are consid- 
ered to be parlor tricks by most com- 
petent Rorschach interpreters, On the 
other hand, a history including de- 
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scription of the patient’s symptoms 
and a psychiatric evaluation undoubt- 
edly influences interpretation so that 
we are no longer dealing with the re- 
liability of the Rorschach test alone 
as a clinical instrument. The aim of 
the study was to simulate clinic con- 
ditions but to minimize cues other 
than the Rorschach test. Each Ror- 
schach protocol was therefore ac- 
companied by an abstract of the pa- 
tient’s life history containing some 
facts of his life but no information 
about the patient’s personality traits, 
emotional reactions or the opinions 
of others about him. The life history 
abstract included the patient’s age 
and sex and the most important facts 
of his family, educational, occupa- 
tional, marital, religious, military 
and medical history. 


The control judges 


In order to evaluate the agreement 
of the Rorschach interpreters, the life 
history abstracts of the 20 ABC pa- 
tients were submitted to three clinical 
psychologists (R, S and W) and the 
life history abstracts of the 20 DEF 
patients were submitted to three other 
clinical psychologists (X, Y and Z). 
They were asked to answer the ten 
items of the questionnaire from the 
information contained in the life his- 
tory abstract alone. These psycholo- 
gists averaged 714 years of clinical ex- 
perience. 


RESULTS 


The Reliability of Interpretation 


We are interested in the relative 
agreement between Rorschachers and 
between control judges and in the 
relative reliability of Rorschach scor- 
ing and interpretation. The applica- 
tion of the Pearson coefficient of cor- 
relation to this kind of data is ques- 
tionable. The phi coefficient was there- 
fore used as the measure of degree of 
relationship. 


The degree of agreement between 
Rorschachers on the first nine items 
of the questionnaire is presented in 
the top half of Table I. 


(Item 10 is presented separately in 
Table Il). The answer categories of 
each item were assigned numbers, e.g. 
for item 1: 

5 Very Superior 

4 Superior 

3 Bright 

2 Average 

1 Dull 
Rorschachers A, B and C’s judgments 
on this item were tabulated in a sin- 
gle combined frequency distribution, 
the median obtained and all judg- 
ments above the median were High, 
all judgments below Low. The same 
procedure of dichotomizing the judg- 
ments was followed on all nine ques- 
tionnaire items. Rorschachers A, B 
and C averaged a phi coefficient of 


TABLE I—Agreement among the Different Pairs of Rorschachers and 
Control Judges on Questionnaire items: phi coefficients 


Rorschacher 

pair 1 z 5 4 
A and 38 06 12 48 
A and 36 06 Bi 05 
B and 58 39 80 25 
D and 13 05 89 .29 
D and a Al = fT 
E and Al .20 36 31 





Mean for each questionnaire item 


Rorschachers............ 44 09 46 .22 
Control judges......... 56 Be 44 12 
eee 138 2.53* .12 75 


Mean for 

5 6 7 8 9 each pair 
33 10 29 48 37 .29 
36 41 39 89 20 32 
A5 47 .29 54 18 45 
39 12 21 31 33 37 
A2 54 29 59 45 30 
30 10 06 AQ 31 27 

Overall 
Mean 

38 29 24 55 31 33 
43 Al 10 08 36 31 
71) #105 156 4.27** .83 .29 


* Significant at the 2% to 5% level 
** Significant at the 1% level 
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Taste 11—Comparison of Agreement among Rorschachers and among 
Control Judges on item 10 
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+.35 and Rorschachers D, E and F 
averaged +.31. The lack of significant 
difference between the two sets of data 
justifies the combination of data of 
the two duplicate experiments. 

The questionnaire items differ 
among themselves and although the 
differences are not large, item 8 on 
sensitivity in human _ relationships 
stands out as the best and item 2 on 
intellectual efficiency stands out as the 
poorest. The weakness of item 2 is 
striking because Rorschach literature 
abounds with statements about the 
advantage of the Rorschach test over 
standardized intelligence tests in dis- 
criminating between intellectual ca- 
pacity and intellectual functioning. 

The bottom half of Table I pre- 
sents the comparison between Ror- 
schachers and control judges on the 
first nine questionnaire items. Differ- 
ences between Rorschachers and con- 
trol judges are small and non-signifi- 
cant? except for items 2 and 8. For 
items 1 and 2, intellectual capacity 
and intellectual efficiency, the control 
judges all reported utilizing the edu- 
cational and occupational level of 
each subject and with these simple 
facts were able to agree better than 
the Rorschach workers. On item 8, 





?A question may be raised as to the ap- 
plicability of the “t” test here. A new 
Statistical test for the significance of dif- 
ferences between phi coefficients may show 


some of the “p” values to be inexact. 
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Average number 
of agreements Predicted 
on diagnosis by chance t , 
5.2 2.4 5.73 1% 
3.8 oe ta - oes 
1.54 
10% to 20% 
Average number 
of agreements 
on diagnosis, 
with “presence” Predicted 
agreement by chance t P 
9.8 4.6 9.40 1% 
3.8 0 ga (mms 
6.83 
1%, 


sensitivity in human relationships, 
the Rorschachers agreed significantly 
better than did the control judges and 
on item 7, emotional control, the 
agreement of the Rorchachers is better 
although the difference is not statis- 
tically significant. This suggests that 
we have slanted our questionnaire 
items to the disadvantage of the Ror- 
schach test. The first half of the ques- 
tionnaire deals with intellectual func- 
tioning, drive and work habits. It is 
on the second half of the question- 
naire which emphasizes emotional be- 
havior and symptomatology that the 
Rorschachers do relatively better. 


This is borne out in Table II. The 
control judges do poorly in selecting 
the Gutstanding symptom or diagnos- 
tic feature; one judge described ans- 
wering item 10 as “blindman’s buff” 
and another called it “pure guess- 
work.” The top half of Table II refers 
to absolute agreement, i.e. the number 
of protocols (out of 20) on which two 
Rorschachers or two control judges 
agreed on the outstanding symptom 
or diagnostic feature was counted up 
and averaged for the six pairs of Ror- 
schachers and six pairs of control 
judges. 

Several of the Rorschach interpret- 
ers checked more than one symptom, 
indicating which they considered pri- 
mary and which were merely present. 
Rorschachers might therefore «agree 
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about the presence of a particular 
symptom or diagnostic feature even 
though one counted it as outstanding 
and the other as secondary. If agree- 
ment in this sense is considered, the 
Rorschachers’ average number of 
agreements shifts from 5.2 to 9.8. The 
control judges never checked more 
than one symptom so that their av- 
erage remains unchanged, 3.8 agree- 
ments. When Rorschachers and 
control judges are compared, Ror- 
schachers agree significantly better in 
diagnosis. —The Rorschachers agree 
among themselves on diagnosis sig- 
nificantly better than chance. 


THE RELIABILITY OF SCORING 


Since all Rorschachers used the sys- 
tem of main and additional scores, 
each main score was weighted 1.0 and 
each additional score 0.5. As was done 
with the questionnaire data, the scores 
of the three Rorschachers (A, B and C 
or D, E and F) were tabulated in a 
single frequency distribution. Scores 
above the midpoint were High, those 
below Low. This conversion of contin- 
uous into dichotomous distributions 
means that the phi coefficients ob- 
tained are conservative estimates of 
the degree of relationship but this 
method was used in order that agree- 
ment in scoring be comparable with 
agreement in interpretation. 

The phi coefficients obtained on the 
six pairs of Rorschachers were aver- 
i The mean phi coefficients of 
agreement in scoring W, D d, Dd §S, 
M, m, k, FK, F, FC, CF, C, H, Hd, A 
and P were significant at the 1% level. 
The mean phi coefficients of agree- 
ment in scoring FM, K, Fc and Ad 
were significant at the 5% level. Only 
in scoring C’ and c was the agreement 
non-significant statistically. When the 
overall mean phi coefficient of scoring, 
+.64 is compared with the overall 
mean phi coefficient of interpretation, 
+.33, a t value of 6.89 is obtained, 
significant at the 1% level. Beyond 
question, Rorschachers agree better in 
scoring protocols than in interpreting 
them.” 


The question may be put: are the 
queneneh on which Rorschachers 
agree in scoring the same protocols 
on which they agree in interpretation? 
An Interpretation Agreement Score 
was obtained for each protocol: if all 
three Rorschachers rated a protocol 
on a given questionnaire item as 
High High High or Low Low Low, 
this was counted as an agreement. 
The maximum Interpretation Agree- 
ment Score for any given protocol 
was, then, nine (item 10 was omitted). 
In the same way, a Scoring Agree- 
ment Score was obtained. When 
these two sets of scores are correlated, 
the Pearson coefficient of correlation 
is — .11. The ABC cases alone yield- 
ed an r of —.10 and the DEF cases 
yielded an r of —.12. The answer 
then is that the protocols on which 
Rorschachers agree in scoring are by 
no means the same protocols on which 
they agree in interpretation. The 
tendency toward an inverse relation- 
ship may be accounted for to some 
extent by the fact that the long pro- 
tocols with many responses tended to 
be high in scoring agreement but low 
in interpretation agreement. 
Another question related to agree- 
ment in interpretation among Ror- 
schachers may be raised. The Ror- 
schachers were asked at the outset to 
list the Rorschach scoring factors, 
—— and quantitative, which 
they considered relevant to each ques- 
tionnaire item. The amount of agree- 
ment among Rorschachers as to the 
relevant scoring factors differed from 
item to item. Are the questionnaire 
items on which Rorschachers agree 
more about the relevant scoring fac- 
tors the same questionnaire items on 
which they agree more in interpreta- 
tion? When questionnaire items are 
ranked in order of agreement about 
relevant scoring factors and ranked in 
order of agreement in interpretation 
a rho of +.85 is obtained, It 
would seem then that when Rorsch- 
achers agree more on what is relevant 
to some aspect of interpretation, they 
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are more likely to agree on that in- 
terpretation. 


DISCUSSION 


It is quite evident that the inter- 
examiner reliability of the Rorschach 
is low as gauged by the methodology 
ot this study. One may question 
whether a questionnaire is an appro- 
priate instrument for studying Ror- 
schach reliability. While there is much 
to be said for the method of matching 
interpretation reports, it is still to be 
expected that independent Rorschach 
interpreters will answer questions 
about a particular subject’s intelli- 
gence, emotional behavior, symptoms, 
etc. in approximately the same way. 
In a questionnaire methodology, the 
global aspect of Rorschach interpreta- 
tion is retained because the inter- 
preter is free to use any and all of 
the scoring and content in answer- 
ing the questions put to him. 

The real and basic problem here 
is: what are the questions to ask or, 
put even more broadly, what is the 
Rorschach test supposed to test? The 
results of the preliminary survey of 
Rorschachers’ opinions done by the 
writer were essentially consistent with 
the textbooks and manuals of Ror- 
schach interpretation. Significantly 
enough, these Rorschachers agreed 
most of all that the Rorschach tests 
the following: 

functioning under stress, emotional 

control, control of anxiety 

intellectual level, functioning and 


efficiency 

sexual attitudes and sexual be- 
havior 

human relationships, emotional] re- 
lationships 


dependence and dominance 
Yet, in the questionnaire used, item 2 
dealing with intellectual efficiency, 
item 7 dealing with emotional control, 
item 6 dealing with passivity and as- 
sertiveness, and item 9 dealing with 
sexual adjustment were among the 
poorest. The existence of agreement 
about what the Rorschach is supposed 
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to test does not necessarily make for 
agreement in those areas. 

It may very well be that the Ror- 
schach cannot and should not be re- 
quired to stand alone. In a clinical 
work situation, the Rorschach test is 
used in conjunction with life history 
material, with interview cues and with 
the results of other tests. In this con- 
text, the Rorschach test results may 
contribute a good deal but it is a good 

ossibility that the Rorschach test by 
itself cannot meet rigorous scientific 
and statistical criteria for reliability 
and validity. The proper definition of 
global interpretation may have to in- 
clude more than the test responses 
themselves. 

Another possibility presents itself: 
there may be certain aspects of Ror- 
schach interpretation which can be 
made from Rorschach test data alone 
and which can stand up under tests 
of reliability and validity. Results 
with the questionnaire used in this 
study were uneven. (One important 
practical limitation in evaluating the 
obtained results is the absence of any 
information about the reliability of 
the questionnaire items themselves. 
Since the questionnaire was not pre- 
tested, the results obtained with it 
must be evaluated tentatively.) Ques- 
tionnaire item 8 on sensitivity in hu- 
man relationships proved to be a good 
one. When the Rorschachers in this 
study agreed more about the scoring 
factors relevant to a particular ques- 
tionnaire item, they agreed more in 
interpreting that item. Item 8 ranked 
second in agreement among Ror- 
schachers about the relevant scoring 
factors (item 1 was first), It is signifi- 
cant that items 2 and 4, which showed 
the lowest reliability in the question- 
naire, also showed the lowest agree- 
ment about relevant Rorschach scor- 
ing factors. It seems clear then that 
where Rorschach workers can come to 
agreement about the scoring and con- 
tent material relevant to an aspect of 
interpretation, they will be much 
more consistent with each other in 
interpreting that aspect than in inter- 
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preting aspects in which no such 
agreement exists. 

This raises the question as to whe- 
ther the agreement among Rorschach 
interpreters in this study would have 
been improved if there had been dis- 
cussion of the questionnaire. It is the 
impression of the writer that it would 
have, in spite of the conclusion by 
Forer, Farberow, Meyer and Tolman 
that, ‘““The group learning process did 
not lead to consistent increases in in- 
terrater agreement on judgment of 
signs or diagnoses,” (2, p. 351). The 
Rorschachers referred to were staff 
psychologists in the same agency and 
clarification and agreement may have 
reached “its apparent limit” before 
weekly conferences were begun. Agree- 
ment among the Rorschach interpret- 
ers in this study could have been ex- 
pected to improve, however, if con- 
ferences and discussions took place 
about the handling of each question- 
naire item, i.e. about the different 
Rorschach scoring and content factors 
related to each. 

The relatively good agreement 
among the Rorschachers in this study 
on item 10, the outstanding symptom 
or diagnostic feature, is encouraging. 
The Rorschach test is rooted histori- 
cally and has bloomed for the past 
thirty years in the problems of psy- 
chopathology. The number of studies 
and the amount of data available on 
normal individuals is relatively neg- 
ligible. We know virtually nothing 
about the Rorschach counterparts of 
constructive, adaptive behavior. There 
is, however, an enormous amount of 
Rorschach literature available on 
Rorschach indicators of schizophrenia, 
neurosis, organic brain disease, etc. 
The Rorschach test is a diagnostic in- 
strument in a double sense: it may 
yield a diagnosis of certain psycho- 
pathological trends and it is supposed 
to yield, in addition, a “personality 
diagnosis,” i.e. a description of the 
subject’s personality traits and the 
dynamic interplay between these 
traits. The indication of the present 
study is that the Rorschach test is 


weak in the inter-Rorschacher agree- 


ment on the latter. 


SUMMARY 


1. Forty Rorschach protocols were 
randomly divided into two sets of 
twenty protocols. One set (ABC) was 
submitted to three Rorschachers A, B 
and C and the other set (DEF) was 
submitted to three Rorschachers D, E 
and F for scoring and interpretation. 
The Rorschachers were also given a 
brief abstract of the subject’s history. 
Interpretation involved answering ten 
questions about the subject’s intelli- 
gence, personality traits and diagnosis. 
The life history abstracts were sub- 
mitted to six control judges who were 
asked to answer the same ten ques- 
tions. 

2. In general, the Rorschachers did 
not show significantly better agree- 
ment than did the control judges. On 
two items, sensitivity in human rela- 
tionships and diagnosis, agreement 
among Rorschachers was significantly 
better than among control judges. The 
control judges agreed significantly bet- 
ter than the Rorschachers on the ques- 
tion of intellectual efficiency. 

3. Agreement among Rorschachers 
in scoring Rorschach protocols was 
significantly better than agreement on 
the questionnaire items. The relation- 
ship between the reliability of scor- 
ing and the reliability of interpreting 
the test protocols was small and in- 
verse, —.11. 

4. The Rorschachers listed those 
Rorschach scoring and content factors 
they considered relevant in answer- 
ing each questionnaire item. A high 
degree of relationship was found be- 
tween their agreement on this listing 
and their agreement on the different 
questionnaire items, 

5. It is concluded that the inter- 
examiner reliability of the Rorschach 
test is not an all-or-none problem. It 
would seem that there are certain as- 
pects of interpretation which can be 
made from the test data and which 
can stand up to tests of reliability. 
More discussion and methodological 
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study are needed in the Rorschach 
counterparts of personality traits and 
adaptive behavior. 
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A Critique of Current Methods of Rorschach Scoring 


THOMAS Pick 
Psychologist’s Office, Education Department, Hobart, Tasmania 


INTRODUCTION 


Relatively little work has been done 
so far on the rationale of Rorschach 
scoring. Furthermore, in the few pub- 
lications on the subject no attempt 
has been made at a systematic analysis 
in terms of what the various scores 
refer to. Relevant questions in this 
connexion are: Does the score refer 
to qualities of the ink blots—if so, to 
what qualities? Or does it refer to 
associative processes in the subject’s 
mind at the moment of, and immedi- 
ately prior to, giving the response? 
Or does it reflect the relationship of 
a particular subject’s particular re- 
sponse to similar responses which 
were given by a population of sub- 
jects of which this particular subject 
is taken to be a member? An en- 
deavour will be made here to show 
that by means of such and similar 
questions inconsistencies and internal 
contradictions of scoring come to the 
fore. Suggestions will also be offered 
for changes in scoring and adminis- 
tration in order to remedy these 
shortcomings. 


1) Is an inquiry into the rationale of 
Rorschach scoring necessary and/ 
or profitable? 


It could be argued that empirical 
validation is not only more impor- 
tant than a logical analysis of scoring 
methods but also renders the latter 
unnecessary, After all, improving the 
rationale of scoring does not make a 
test more valid whereas empirical 
validation, of course, does. 


It is felt that this argument in its 
extreme form holds little water. First- 
ly, a scoring method or a few alter- 
native scoring methods have to come 
first and validation after; secondly, 
as a corollary to the first point, the 
degree of the test’s validity is a func- 


tion of the quality of its scoring sys- 
tem which in turn depends upon 
such factors as logical consistency of 
scoring. Thus, an inquiry into the 
rationale of scoring indirectly also 
contributes to the validity of the test. 
Furthermore, it may help settle dif- 
ferences in scoring between the vari- 
ous “schools” by clarifying the issues 
involved, 


2) Raison d'etre of projective tech- 
niques and major difficulties in 
their use. 


Rosenzweig (9) makes the point 
that the major advantage of projec- 
tive techniques is that by using them 
we are able to penetrate to the more 
permanent and constant, deeper lay- 
ers of personality thus enabling us to 
make better predictions. To extend 
his argument, one could differentiate 
between “extrapolating” or “situa- 
tional” prediction, on the one hand, 
and “dynamic” interpretation on the 
other hand. In the case of the former 
type of prediction its accuracy de- 
pends on the similarity between the 
test situation and the criterion situa- 
tion to which we intend to predict; 
a good example of this type of pre- 
diction in pure culture is the WOSB’s 
procedure (4). “Dynamic” prediction, 
on the other hand, does not rest on 
the assumption that the test we pre- 
dict from is homologous to the situa- 
tion we wish to predict to; other 
things being equal this factor could be 
expected to make for better predic- 
tions. However, with “dynamic” pre- 
dictions there is a considerable “in- 
ferential jump”: from the test per- 
formance, underlying structures or 
processes are inferred which, in turn, 
enable us to make predictions. This 
inferential jump can be expected to 
lower the precision of our prediction. 
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Thus, the scoring, in other words 
translation of significant elements of 
the test performance into a code, be- 
comes a link in the long chain leading 
from test performance to prediction. 
Although the above holds for psycho- 
metric tests as well, scoring being a 
more complex procedure in the Ror- 
schach it becomes a more vexing and 
all-important factor with the latter. 
Thus, an examination of the ration- 
ale of scoring must be the starting 
point for any move to improve the 
validity of the Rorschach. 


3) Variants of scoring schemes. 
A scoring unit can be arrived at 


(i) on the basis of the response 
proper 
(a) by means of correlation with 
some criterion measure. In the case 
of psychometric tests the criterion is 
either performance on the test as a 
whole or performance on an outside 
criterion. Historically, an example of 
this kind of scoring unit in the Ror- 
schach is the Do score which Ror- 
schach thought was pathognomonic 
of mental deficiency. Thus, this scor- 
ing scheme is based on the relation- 
ship between response, 1.e., the expres- 
sive end-product of a thought process 
started off by test stimuli, on the one 
hand, and some kind of characteristic 
it is expected to predict, on the other 
hand. It follows from this that it de- 
pends on experience with a popula- 
tion disregarding the process by means 
of which the individual arrives at a 
response. That is, the scoring system 
takes account of what the response is, 
without, however, differentiating be- 
tween several ways of arriving at the 
same end product. This criticism 
holds for all scoring systems based 
only on the response proper as well 
as for factor-analytic studies; both 
the relative importance and the func- 
tion of “factors” may differ from in- 
dividual to individual. 


(b) On the basis of some formal 
characteristic of the response, e.g., 
content on the Rorschach or aggres- 
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sive or submissive remarks on the 
TAT. 

(c) By means of the frequency of 
the response in question in the popu- 
lation; examples are the frequency 
approach to the Word Association test 
(8) and the popularity-originality di- 
mension in the Rorschach. 

(d) By categorizing the relation- 


‘ship between stimulus and response, 


e.g., location score in the Rorschach 
or omission of some person or object 
from the story in the TAT. 

(ii) By means of a phenomenologi- 
cal analysis of the response, Thus, in- 
stead of scoring what the response is, 
one categorizes the process or rather 
the introspective perception of the 
process by means of which the re- 
sponse was arrived at. It can be argued 
that phenomenological scoring gives, 
other things being equal, more infor- 
mation about the subject than any 
other scoring method. It yields infor- 
mation about the subject qua indi- 
vidual and not only as a member of 
a population; or, to be more precise, it 
differentiates between individuals 
giving the same response. An impor- 
tant difference, then, between phe- 
nomenological and non-phenomenol- 
ogical scoring is that the former is 
done in the frame of reference of the 
subject, entering into his perceptual 
field, so to speak. The best examples 
for phenomenological scores are the 
determinants in the Rorschach; they 
will be the main concern of our dis- 
cussion. It follows from what has been 
said before that phenomenological 
scoring is eminently suitable for dyn- 
amic prediction as it categorizes proc- 
esses underlying manifest behaviour; 
for this same reason the likelihood of 
error in interpretation is also reduced 
(if the score is a valid measure of 
what it is supposed to measure). 


4) A discussion of Rorschach scores 
with particular emphasis on de- 
terminants. 


Aspects of the response scored in 
the Rorschach: 
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(i) categorizing the relationship be- 
tween stimulus and response. Two 
types of scores fall into this category: 

(a) the location score defines the 
relationship of the area utilized in 
the response to the total blot area. 

(b) Form level rating in terms of 
accuracy and specification is a score 
based on goodness of fit of the blot 
area to which the response was given 
to the corresponding object in nature. 
Organization, however, falls into a 
different category and will be dis- 
cussed later. 


(ii) The content score is based on a 
formal characteristic of the response. 

(iii) Popularity or originality is 
scored according to the frequency of 
the response to a particular area of a 
particular card in a particular popu- 
lation. 

(iv) Iwo scores are based on phe- 
nomenological criteria: 

(a) the organization aspect of the 
form level rating which refers to the 
organizing process by means of which 
the subject arrives at the response; 

(b) determinant scores. 

Let us, then, attempt to define what 
is meant by determinant score in the 
Rorschach. There are two criteria, a 
general and a specific, constituting a 
determinant score.’ Firstly, the de- 
terminant score designates the salient 
feature (s) in the subject’s perception 
in the test; this criterion is vague but 
holds for all determinant scores. The 
main objection against it may be that 
it lacks anchoring in the test material; 
thus, it cannot be directly used as a 
description of the subject’s verdal be- 
haviour in relation to the test mate- 
rial. According to the second criterion 
the determinant score designates that 
feature or those features in the stimu- 
lus material which appear (s) to have 
contributed to producing the response. 





1 Also needed, of course, is a system of deter- 
mining features in perception. It is felt that 
too little thought has been given to select- 
ing the most important and most useful 
determining features. 
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This definition is less vague than the 
first one and is anchored in the stim- 
ulus material; consequently, it pro- 
vides a link between stimulus, on the 
one hand, and perception and perceiv- 
er, on the other. Yet it has a major 
disadvantage: it does not account for 
movement and for Klopfer’s three 
shading variants, c, K, and k, as de- 
terminants. 

It is felt that there is insufficient 
differentiation between “objective” 
and “subjective elements” in scoring. 
By “objective stimulus element” I now 
mean the feature in the stimulus ma- 
terial which produces the response in 
the subject and by “subjective stimu- 
lus elements” I mean features project- 
ed into the stimulus material by the 
subject. For example, in the case of 
the popular response to Card III the 
“objective stimulus element” is al- 
most invariably form and the “sub- 
jective stimulus element” more often 
than not human movement. The lat- 
ter is not a feature of the blot; it is 
projected into the blot by the subject. 
It can be argued, of course, that it 
must be a feature of the blot; other- 
wise the human movement response 
would not be a popular. However, it 
must be borne in mind that the 
phrase “feature of the blot” was now 
used in a sense different from how I 
used it. The extreme case would be 
the m response where the determin- 
ant has a “subjective stimulus ele- 
ment” only. 


Before we go any further I wish to 
clarify this issue. The objective stim- 
ulus elements are those features of the 
blot which produce the response in 
the subject. Let us now examine the 
implications of this statement for 
movement and Klopferian shading re- 
sponses. 


If movement is perceived in the 
blots it can be perceived in one or 
more of three ways: 


(i) in the case of kinaesthetic move- 
ment responses the process appears to 
be a most complex one. Mainly on 
the basis of form perception the sub- 
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ject experiences, however dimly, some 
empathy with the movement, and it 
is this kinaesthetic proprioception 
which is then scored with the appro- 
priate movement score. Thus, in this 
case an element of proprioception, not 
exteroception, is being scored. 


(ii) Movement can be perceived by 
means of an associative process. Thus, 
an object may be perceived which is 
usually seen in motion in nature and 
is therefore also seen as moving; or a 
sign is perceived which is stereotypi- 
cally associated with motion, eé.g., -}<- 
as explosion (2). 

(iii) It is perceived in relation to an 
implied background, I am referring 
to the fact that movement is not an 
absolute attribute of an object but 
can only be conceived of in relation 
to another object or group of objects 
or substance. 


Naturally, the above three categor- 
ies are not mutually exclusive. 


It should be apparent that the 
above three criteria differentiate 
sharply between movement as a de- 
terminant, on the one hand, and other 
determinants, on the other hand. Cri- 
teria (i) and (ii) have as common ele- 
ments the fact that the feature to 
which the movement score refers is a 
link in a process initiated by the 
stimulus, yet distinguishable from the 
immediate response to the stimulus. 
To use Rapaport’s terminology (7), 
this feature is part of a “distant” re- 
sponse, using the word ‘distant’ in its 
descriptive and not in its dynamic 
sense. Criterion (iii) refers to the fact 
that movement is the only determin- 
ant which does not refer to an abso- 
lute stimulus attribute, i.e., a stim- 
ulus attribute which is independent 
of the relationship of this. stimulus: to 
other spatially and temporally con- 
tiguous stimuli. 


The Klopferian shading score also 
refers to a “distant” response to the 
blot. B. Klopfer gives the following 
definitions (5, p. 126): 
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c: shading gives the impression of 
surface or texture. 

K: shading gives the impression of 
three-dimensions or depth, either in 
the sense of diffusion (K or KF) or 
vista (FK). 

k: shading gives the impression of 
a three-dimensional expanse project- 
ed on a two-dimensional plane. 

It will be noted that all three defi- 
nitions start with “shading gives the 
impression of ...” i.e., the objective 
stimulus element is in all three cases 
taken to be the same. Yet Binder’s 
Hd (hell-dunkel), Loosli-Usteri’s Clob 
(clair-obscur), and Schafer’s Ch are 
scores in terms of the objective stim- 
ulus element; it is only through Klop- 
fer’s refinement that the shading 
score becomes a score in terms of both 
objective and subjective stimulus ele- 
ments. It is a score in terms of the 
objective stimulus element insofar as 
it is a response to differences in shad- 
ing and in terms of the subjective 
element insofar as the impression the 
shading gives is concerned. 


Thus, there is an irreducible con- 
tradiction in the Rorschach concept 
of determinant. If what I called the 
subjective stimulus element is the 
basis of the determinant score, a hal- 
lucinatory determinant such as, to 
take a relatively mild case, a bright 
colour seen in an achromatic card, 
should be scored as such, that is as a 
colour response. If, however, the ob- 
jective stimulus element is used here 
as a basis, it is very likely that the 
phenomenological smneende will not 
yield a determinant score; if it will 
the score must necessarily be differ- 
ent as it can only be a score in terms 
of objective perceptual features and, 
as the card is achromatic, the score 
must be other than colour. 

It follows, then, that there always 
may be cases where there remains an 
unscored gap in the perceptual proc- 
ess between stimulus and response. 
Using the subjective stimulus element 
as a basis the gap, if it occurs, is be- 
tween stimulus, on the one hand, and 
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perceptual feature,? on the other; 
using the objective stimulus element 
there may be an irreducible gap be- 
tween stimulus features* and response, 
the perceptual feature remaining an 
unknown. 


Therefore, from the point of view 
of objectivity of scoring, the starting 
point in determinant scoring should 
always be the objective stimulus ele- 
ment; determinant scoring on the 
basis of the subjective stimulus ele- 
ment should be resorted to only if 
there are some features in the re- 
sponse still unaccounted for in terms 
of the objective stimulus elements. 
The implication here is that the Ror- 
schach being a standardized test the 
first objective in scoring is to estab- 
lish or rather categorize a relation- 
ship between stimulus and response. 


However, the contradiction in de- 
terminant scoring goes further, In the 
case of co-determinant scores (e.g., 
FC) the primacy of the co-determin- 
ants (FC or CF) is decided either on 
the basis of “objective” or on the 
basis of phenomenological criteria. 
What happens if the two clash? Let 
us take colour responses as an exam- 
ple. There are two main criteria on 
the basis of which one is to decide 
whether form or colour is primary if 
there is both a form and a colour ele- 
ment in the response. 


(i) Has the object to which the blot 
is equated a definite shape? If so, the 
score is FC. This is an objective cri- 
terion, 7.¢€., on its basis any subject 
giving that response to a certain loca- 
tion will be credited with an FC score 
irrespective of what produced the re- 
sponse in his phenomenal field. 





? Perceptual features are all those attributes 
of the stimulus as perceived by the subject 
on the interactive aggregate of which that 
particular individual’s perception is based. 
® Stimulus features are all those attributes of 
the stimulus on the interactive aggregate of 
which perceptions are based (wave length 
for colour, spatial relations for form, differ- 
ences in intensity of light reflected for shad- 
ing, intensity of light reflected for achro- 
matic colour). 
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(ii) Which was, subjectively, the 
more important co-determinant pro- 
ducing the response? This is a sub- 
jective, phenomenological criterion; 
thus, it may happen that two identi- 
cal responses to the same area may 
get a different score using this cri- 
terion. Thus, according to this cri- 
terion the response “coral” to the pink 
portion on card X could be either FC 
or CF. What is to happen, then, if 
the two considerations clash, if, as in 
this case, the “objective” score is CF, 
the phenomenological, however, hap- 
pens to be FC? 

This is not an argument against 
using the “objective” criterion of defi- 
niteness of shape as a basis for de- 
termining the primacy of co-determin- 
ants; in most cases it decides the issue 
in terms of phenomenological primacy 
as well, However, it is maintained that 
if there is a clash between the objec- 
tive and the phenomenological cri- 
teria of primacy of co-determinants, 
the scoring should take note of this 
fact. 

A further complication arises if a 
co-determinant score is reserved for a 
specific sub-category of responses, e.g., 
Klopfer’s FK being reserved for three- 
dimensional perspective responses 
whereas K and KF are scores for dif- 
fusion. As the scores stand, it can be 
at least disputed if FK lies on the 
same perceptual continuum with KF 
and K. It is suggested that there is no 
good reason why FK should be re- 
tained as a restrictive score. 

In phenomenological scoring there 
is always an element of uncertainty. 
One of the elements of uncertainty 
which cannot be resolved is whether 
or not a determinant was used by the 
subject in the performance proper or 
whether it has occurred to him in the 
inquiry only (see below). From the 
fact that there are various degrees of 
uncertainty in scoring determinants it 
follows that there are cases where a 
decision as to what score is more ap- 
propriate cannot be made on the basis 
of the response and the inquiry only. 
In those cases there seem to be two 
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possible means of deciding the issue, 
both based on the concept of statis- 
tical regression: 


(i) On a population basis. The score 
given is based on the determinant 
most frequent for that particular re- 
sponse in the population of which the 
subject is a member. 

(ii) On a subject-inclination basis. 
The scoring is based on the observed 
fact that in other responses to the 
same objective stimulus elements the 
subject tends to use one determinant 
more often than others. 

Whether criterion (i) or (ii) should 
be used depends on how typical a 
member of the normative population 
the subject is. As from the point of 
view of objectivity of scoring the use 
of criterion (i) is preferable. Criterion 

(ii) should be used only if, firstly, 
there is strong evidence for the sub- 
ject’s tendency to use a certain de- 
terminant in his response to certain 
objective stimulus elements, and sec- 
ondly, if there is good evidence for 
the subject’s being markedly atypical. 

Now let us look into a further com- 
plicating factor with determinants: 
Levin (6) claims that there are “two 
tests in the Rorschach”: firstly, the re- 
sponses in the test proper, and sec- 
ondly, the subject’s performance in 
the inquiry. He says that current 
methods of Rorschach scoring fail to 
differentiate between Test A (in the 
performance proper) and Test B (in 
the inquiry). In the main his criticism 
is twofold. On the one hand, he feels 
that what he loosely calls introspec- 
tion in the inquiry may have little 
validity; yet he feels that, on the other 

hand, information may be lost by 
failing to differentiate between the 
two tests, as Test A “would reflect 
more of the need and drive states, 
while Test B would reflect more of the 
defense systems and other ego func- 
tions.’ 


Levin’s criticisms are legitimate 





“Recent work on the relation of Rorschach 
free association to inquiry seems promising 
in this connexion (3). 
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enough as far as they go. Yet it is felt 
that the problem cannot be wholly 
resolved as, in the case of determ- 
inants, the only alternative to scoring 
on the basis of the inquiry—excluding 
the cases where the response proper is 
sufficient for scoring—would be to as- 
sign a score solely on the basis of the 
response proper. Here, the implica- 
tion is that the score would be given 
in terms of what the Germans call 
‘Leistungspsychologie’, i.e., consider- 
ing the end product only and disre- 
garding the process by means of which 
the subject arrived at his response; 
the only exception would be a re- 
sponse so complete that an inquiry 
into it would be unnecessary anyway. 
Thus, the score would be arbitrary 
(the phenomenological score as seen 
by the individual who decides) or, at 
the best, the most frequent phenomen- 
ological score in the population (see 
below). If the latter kind of scoring 
is adopted, scoring in terms of Test 
A and Test B separately may supply 
additional information. However, this 
would involve scoring norms for re- 
sponses (i.¢., relative frequencies of 
determinants “objective determin- 
ants,” to be more precise, see below) 
for a given response to a given area. 
It should also be noted that the 
terms Test A and Test B were now 
used in a sense distinctly different 
from how Levin used them. The de- 
terminant score in Test A here is not, 
as Levin assumed, the “true” determ- 
inant in the performance proper for 
the simple reason that it cannot be 
ascertained. However, Levin’s criti- 
cism still applies to the phenomenol- 
ogical determinant score. It should be 
self-evident that the error cannot be 
eliminated; it can, however, be re- 
duced considerably by systematically 
varying the objective stimulus ele- 
ments in the inquiry. 

Baughman (1) suggests three alter- 
native methods of utilizing modified 
blots. Firstly, they may be used after 
the inquiry by presenting the subject 
with the required modified card and 
ask him in what way, if any, his per- 
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cept is modified. A second possibility 
would be to begin the inquiry period 
with them. A third method was pro- 
posed by Zubin in a personal com- 
munication to Baughman. The es- 
sence of his suggestion was that each 
of the modified series be presented to 
groups of Ss in the usual manner. 
Tables would then be constructed 
showing the number of times each re- 
sponse occurred in each series and 
these tables would then be used as 
standards for scoring determinants. 
The essential, secondary, or insignifi- 
cant role of each determinant for a 
specific response could be assessed by 
reference to the distribution of the 


response throughout the various 
series. 
However, it should be borne in 


mind that, using the modified blots, 
one systematically changes the ob- 
jective stimulus elements. Thus, this 
method is of direct assistance for scor- 
ing in terms of the objective stimulus 
elements only and not for scores in 
terms of subjective stimulus elements. 

My objection against Zubin’s pro- 
posal is that the scores derived from 
his method would be the most fre- 
quent determinants for the response 
in question in the population but not 
necessarily for a particular subject. To 
be sure, the Rorschach can be used 
in that way but by using this type of 
scoring we necessarily lose informa- 
tion about our subject. 


5) Suggestions for changes in scoring 
and in administration. 


Based on the foregoing analysis, the 
following changes to scoring and ad- 
ministration are suggested: 

(i) The scoring of determinants. 

(a) The category “determinants” 
as currently used is a hybrid amalga- 
mation using both objective and sub- 
jective stimulus elements. Therefore, 
it is suggested that in scoring a formal 
distinction be made between “objec- 
tive determinants” (Klopfer scores F, 
C, C’, and Schafer’s Ch, based on ob- 
jective stimulus elements) and “sub- 
jective determinants” (Klopfer scores 


M, FM, m, k, K; and hallucinatory or 
illusional responses). The hypotheti- 
cal case referred to earlier where a C 
response was given to an achromatic 
card would then be scored as C’ or 
Ch in the column for objective de- 
terminants, and as C in the column 
for subjective determinants, Thus, ev- 
ery response would have an objective 
determinant score, and some responses 
would also have a subjective determ- 
inant score. The popular human re- 
sponse as a W to card III would then 
be scored W F M H P (form level 
rating remaining optional). This 
scoring method would naturally alter 
the meaning of such measures as 
F%, the new F% being the old F% 
(M+FM)%. 

(b) If a determinant cannot be 
scored on the basis of the response 
proper and inquiry into the response, 
the most frequent determinant score 
in the population for that response 
should be given except for very atypi- 
cal Ss who consistently use the same 
atypical determinant in their response 
to given objective stimulus elements. 
Such discrepancies, if they occur, will 
be noted. The scoring will then be 
based on that S’s consistent trend. 

(c) If in the scoring of co-determ- 
inants there is a clash between ob- 
jective and phenomenological criteria, 
the response should be scored both in 
terms of the objective criterion (in the 
objective determinants column) and 
in terms of the phenomenological cri- 
terion (in the subjective determin- 
ants column). 


(d) Klopfer’s FK score should be 
generalized to all responses with a 
definite shape where diffusion is a sub- 
jective stimulus element. 

(ii) Form level rating 


It is felt that in form level rating 
organization as a phenomenological 
aspect of the response should be kept 
separate from accuracy and specifica- 
tion. The latter two, after all, refer to 
the end-product and thus to a differ- 
ent predictive level from the former 
which refers to a process. In other 
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words, accuracy and specification refer 
to what is produced and organization 
to how it is produced; the former two 
are closer to situational, the latter to 
dynamic prediction. 

(iii) The inquiry. 

It seems to me that Baughman’s 
second method where the modified 
cards are presented after the inquiry 
has most to recommend it. The main 
danger with this method is that the 
inquiry may impose a frame of ref- 
erence upon the subject which in turn 
may influence his reactions to the 
modified cards, Therefore, the utmost 
care has to be taken to be nondirec- 
tive in the inquiry, even on card X. 
It is felt that this method is prefer- 
able to starting the inquiry with the 
modified cards as by doing that a num- 
ber of diagnostically valuable verbal- 
izations may be lost. 


SUMMARY 


After emphasizing the importance 
of rationale a scheme categorizing 
scores was discussed. It was then 
shown that Rorschach scores and/or 
aspects of scores fall into the following 
categories: (i) Scores categorizing the 
relationship between stimulus and re- 
sponse; (ii) scores based on a formal 
characteristic of a response; (iii) scores 
based on the frequency of the response 
in the population; (iv) scores based 
on phenomenological criteria. An in- 
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ternal contradiction in determinant 
scoring was then pointed out in that 
some of the criteria used are phen- 
omenological, others objective; it was 
suggested that the two aspects be sep- 
arated into two formal scores, if there 
is a discrepancy between the two. It 
was further argued that in the case 
of determinants maximum informa- 
tion is necessarily gained by scoring 
in the subject’s frame of reference. 
Finally, the use of Baughman’s modi- 
fied cards after the inquiry was rec- 
ommended as a means to render de- 
terminant scoring more reliable. 
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INTRODUCTION 


The purpose of this study is to 
investigate the nature of the relation- 
ship between overt hostility in the 
normal classroom behavior of children 
and the hostile content they produce 
in their Rorschach and Make-A-Pic- 
ture-Story (MAPS) protocols. Previous 
studies and clinical theory in this area 
suggest several specific hypotheses for 
investigation. These hypotheses may 
be stated as follows: 


1. The relationship between hostile 
content in the Rorschach and overt 
hostility will be curvilinear. 

2. There will be a positive, linear re- 
lationship between the hostile con- 
tent on the MAPS and overt hostil- 
ity. 

8. The hostile content of the Ror- 
schach and of the MAPS, when used 
together, will provide a better pre- 
dictive index of overt hostility than 
either measure used singly. 


Hypothesis | is an expression of the 
often-made assumption that hostile 
content in the Rorschach is an expres- 
sion of covert hostile tension, Where 
such covert hostile tension is charac- 
teristically high, it would be presumed 
that the individual is unable to dis- 
charge it adequately through behav- 
ioral or other channels. Hence, high 
levels of hostile content in the Ror- 
schach would ordinarily be associated 
with low overt hostility. Conversely, 
where the individual is able to release 
his hostile tensions via behavioral or 
other channels, the characteristic level 
of covert hostile tension would pre- 
sumably be in the intermediate or low 
range. These assumptions would thus 


imply a curvilinear relationship be- 
tween hostile content scores on the 
Rorschach and overt hostility, 
Hypothesis 2 is based on a common 
assumption in respect to thematic ma- 
terial in general and to the MAPS in 
particular. It is frequently assumed 
that thematic materials allow the sub- 
ject to become aware of the signifi- 
cance of his story responses just as he 
may become aware of the hostile na- 
ture of his actual behavior. (The sig- 
nificances of the responses to the Ror- 
schach blots are probably not as ap- 
parent to the subject.) This aware- 
ness of the significance of his responses 
presumably permits the subject to 
modify and interpret his own re- 
sponses to the MAPS in the same way 
that he is able to interpret and modify 
his overt behavior. On this basis, it 
would be expected that there would 
be a close correspondence between 
story stimuli and real life stimuli and 
that hostile content on the MAPS 
should approximate a direct, linear 
relationship to overt behavior. 


Hypothesis 3 is an outgrowth of 
the first two hypotheses and is also 
in line with the common clinical prac- 
tice of using both the Rorschach and 
a thematic test for diagnostic pur- 
poses. The implication is that the 
two types of instruments tap different 
aspects of the personality so that when 
they are used together they give a 
more accurate basis for prediction of 
behavior than either instrument used 
alone. 


METHOD 


To test the hypotheses of this study, 
it was necessary to obtain reliable and 
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clinically meaningful measures of the 
typical patterns of overt hostility dis- 
played by a group of children and to 
compare these measures with a reli- 
able quantification of the hostile con- 
tent in their Rorschach and MAPS 
protocols. It was deemed desirable 
that the children be relatively unse- 
lected in terms of hostility and its 
manifestations and that they should 
display a relatively wide range of overt 
hostility since such heterogeneity 
would aid in the detection of the 
hypothesized relationships. 

Subjects: The population of this 
study consisted of thirty white male 
children who were enrolled. in the 
Clinical School of the University of 
California at Los Angeles for reme- 
dial instruction in reading. They 
ranged in age from nine to fifteen 
years and there were either two or 
three children representing each six 
month age interval throughout this 
range. Each child had been given the 
Stanford-Binet, The Wechsler Intelli- 
gence Scale for Children, or the 
Wechsler-Bellevue. The group ranged 
from borderline to very superior in- 
telligence. However, for the two cases 
which were below average in intelli- 
gence test scores, the examiners’ re- 
ports indicated that the scores were 
very likely an underestimate of the 
child’s intellectual capacity. The dis- 
tribution of the various levels of in- 
telligence showed the group to be a 
relatively representative sampling of 
the normal intelligence range. 

From preliminary observations, it 
appeared that the distribution of overt 
hostility in the group approximated 
a normal curve. Thus, a few children 
typically displayed a relative lack of 
overt hostility, a few were given to 
frequent and intense acting-out of 
hostile impulses, but the majority 
seemed to fall midway between these 
extremes. 

One factor of note is that all chil- 
dren enrolled at the Clinical School 
are cases of reading retardation. There 
have been no studies that show any 
specific relationship between reading 
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retardation and hostility, However, on 
a speculative level, the frustrations 
and conflicts which might be induced 
by reading problems would probably 
serve to heighten the mean hostility 
level in the group but, unless this 
served to modify the range of hostility, 
it would not necessarily influence re- 
lationships between test and behav- 
ioral measures of hostility. 

Procedure: The Rorschach and the 
MAPS were administered individually 
to each of the subjects by a single ex- 
aminer. The children were tested in 
a random order over a three-week pe- 
riod during which normal school rou- 
tine prevailed. The tests were coun- 
noe oer by alternating the se- 
quence of administration from one 
subject to the next. In general, two 
subjects were tested in the morning 
and one in the afternoon. This test- 
ing procedure randomized situational 
factors such as fatigue, classroom argu- 
ments, time of day, or systematic shifts 
in the examiner’s mood. 

The Rorschach: The Rorschach 
was administered according to Klop- 
fer’s (4) technique with certain modi- 
fications required by this subject pop- 
ulation. If the child gave only one 
response to the first card, he was en- 
couraged by the statement: “People 
often are reminded of several things 
in the card, Why don’t you look at it 
again and see if it might suggest some 
other things too.” Regardless of the 
outcome, no further prompting was 
used. In four cases, as a concession to 
restlessness and short attention span, 
the Inquiry was conducted after the 
completion of each card rather than 
waiting until the subject had respond- 
ed to all ten cards, In all the other 
cases, the conventional method of In- 
quiry was used. 

A scale for scoring hostile content in 
the Rorschach was constructed utiliz- 
ing portions of the methods of Elizur 
(2) and Walker (8).! From this scor- 





1To save printing costs, a full reproduction 
of this scale has been deposited with the 
American Documentation Institute. Order 
Document No. 4879 from American Docu- 











$28 


ing technique a Rorschach Hostility 
Score (RHS) was obtained. Reliabil- 
ity of the scoring was obtained by se- 
lecting ten protocols at random from 
the thirty which were administered. 
All protocols were identified by code 
number only. These records were 
scored by the examiner and two other 
judges. All judges had administered 
more than one hundred and fifty in- 
dividual Rorschachs. The RHS as- 
signed to the ten records by the three 
judges were simultaneously compared, 
using the intraclass correlation coef- 
ficient, r’, according to the method 
suggested by Garrett and Zubin (3). 
A very significant inter-rater reliabil- 
ity was found, r’ = .90. The F-ratio 
was 18.47 which is far greater than 
the .001 level of confidence. This high 
agreement indicated that it was ac- 
ceptable to use the examiner’s RHS 
values for all thirty protocols as the 
Rorschach data to be used in testing 
the hypotheses of this study. 


The MAPS: A battery of eight back 
ground cards of the MAPS was cho- 
sen. The cards used were the Living- 
room, Street, Bedroom, Bathroom, 
Dream, Schoolroom, Cellar, and 
Forest. The first five were suggested 
by Shneidman, author of the MAPS, 
as the most productive cards for a 
short battery. With the exception of 
the Bathroom, these cards were judged 
to be relatively neutral in stimulating 
hostile responses. The other back- 
grounds were expected to be approxi- 
mately equal in the number of hostile 
themes elicited. A tally of the number 
of times each card received any type 
of scoring denoting hostility indicat- 
ed that all, except the Bathroom card, 
elicited approximately the same num- 
ber of hostile themes, ranging from 
fourteen to twenty responses. The 
Bathroom card elicited only three hos- 
tile scores, 

The MAPS was administered ac- 
cording to the standard procedure in- 
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dicated by Shneidman (6). The ad- 

ministration was probably facilitated 

by the fact that none of the children 
had seen this test before, and they re- 

sponded to it as they would to a new 
ame. 

The MAPS protocols were scored ac- 
cording to the TAT Aggressive Con- 
tent Scale developed by Stone (7).! 
Three scores were derived from Stone’s 
scale, based on the number and in- 
tensity of hostile themes produced. 
The MAPS Hostility Score (MHS) was 
obtained by summing the full scoring 
weights assigned to each protocol. The 
Modified MAPS Hostility Score 
(MMHS) was obtained by summing 
the scores assigned to a protocol when 
the potential (P) scores had their 
weights cut in half. (A P score is 
given when the hostile act is not car- 
ried out in the story but is placed in 
the future or is seen as a wish or 
thought.) The MMHS, then, reflects 
not only the frequency and intensity 
of hostile themes, but also the extent 
to which they were actually acted out 
in the stories without modification. 

The Hostility Control Score (HCS) 
was obtained by dividing the number 
of hostile themes in a record which 
were not P scores by the total number 
of hostile themes produced. This 
score, then, represents only the de- 
gree to which the hostile feelings in 
the subject’s hostile themes were 
acted out in the story as overt hos- 
tility, i.e., were expressed without 
modification. 

Using a table of random numbers, 
eighty stories were drawn randomly 
from the total of two hundred and 
forty stories which the subjects had 
told. These stories were scored by the 
examiner and two other judges. Rater 
reliability was checked by the use of 
the intraclass correlation coefficient 
and an inter-rater reliability of r = 
.89 was found. This high degree of 
agreement indicated that the MAPS 
stories were judged with very high 
consistency so that the examiner's scor- 
ing of all thirty MAPS protocols could 
be used to determine MAPS hostility 
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scores utilized in the testing of the 
hypotheses of this study. 

The Rating Scales': Two rating 
scales were constructed using the 
Champney (1) method. One scale per- 
mitted the rating of Physical Hostil- 
ity, the other the rating of Verbal 
Hostility. Quarrelsomeness, the third 
scale in the behavior rating battery, 
was taken from the Fels Child Behav- 
ior Scales (5). The raters were five 
teachers and one graduate assistant. 
Two of the classrooms had two teach- 
ers who divided the teaching day be- 
tween them. The third classroom had 
only one teacher but she had been 
helped for four months prior to the 
time of the ratings by a graduate psy- 
chology student who had spent a min- 
imum of one hour a day in the class- 
room. This student assistant served as 
the second rater for this classroom. 


A pilot study conducted prior to 
the adoption of the rating scales gave 
the teachers experience in defining, 
observing, and recording overt hostile 
behavior in their pupils. Originally it 
was planned that the teachers should 
keep a running record of every in- 
stance of actual or potential overt 
hostility that occurred in the class- 
room during the day and that this 
daily record should serve as the meas- 
ure of hostility for this study. The 
plan proved unsatisfactory because it 
was so time consuming that it inter- 
fered with the teachers’ actual han- 
dling of the classroom. Even though 
it had to be abandoned, it served a 
useful purpose in clarifying the vari- 
ous categories of behavior that were 
to be rated on the rating scales so 
that the teachers were well-trained in 
making the type of observations neces- 
sary. 

The ratings were made on a nine 
point scale, and the ratings for each 
child were indicated by a horizontal 
dash through a vertical nine centi- 
meter line divided into one centi- 
meter lengths. A rating of nine indi- 
cated maximum hostility. Each sub- 
ject received a final score on each scale 
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which represented the average of the 
two ratings he had been given by his 
two teachers. 

In order to avoid a positive trans- 
fer of judgment from one scale to the 
other, several rating scales dealing 
with non-hostile personality attributes 
were placed in between those used in 
this study. In the resulting sequence, 
Physical Hostility was first, Quarrel- 
someness was fourth and Verbal Hos- 
tility was eighth in order of place- 
ment in the battery of scales. The 
halo-effect was also counteracted by 
placing the subjects in a different or- 
der on each of the scales. 


The independence of the three rat- 
ings was tested in one operation using 
the intraclass correlation. The three 
scales were found to intercorrelate 
very highly, with an r’ = .87, demon- 
strating that the children had very 
nearly identical scores on each of the 
three scales. This would indicate that 
any differences in the degree of re- 
lationship found between the various 
ratings and the projective test scores 
would be quite small. 

A general reliability coefficient was 
computed for each scale by computing 
the intraclass correlation for the two 
ratings given each child. The relia- 
bility of all three scales was statistic- 
ally significant beyond the .001 level 
of confidence. 

Analysis of the Data: Two statistical 
measures were used to evaluate the 
hypotheses. The chi square was used 
to test the significance of relationships 
between experimental variables since 
its use does not require making any 
assumptions concerning the distribu- 
tion of the data involved. 

Whenever the degree of correlation 
between two variables was required, 
Tschuprov’s coefficient, T, was used 
(9). Tschuprov’s T is a contingency 
coefficient which is superior to the 
more familiar contingency coefficient, 
C, in that it expresses the degree of 
correlation in values varying between 
zero and one, regardless of the number 
of categories used. 
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To test the hypotheses of this study 
the test and behavior measures were 
divided as near their medians as the 
distribution would permit. The rela- 
tionships between high and low por- 
tions of any two measures were plot- 
ted in a two-by-two contingency table 
so that the appropriate statistics could 
be calculated. The use of more than 
two categories was not possible, as 
the resulting contingency tables would 
have contained cells in which the ex- 
pected frequencies would be below 
five, thus rendering the calculation of 
chi square invalid. 


RESULTS 


To test the hypothesis that the re- 
lationship between hostile content on 
the Rorschach and overt hostility is 
curvilinear, the Rorschach Hostility 
Scores (RHS) were divided into quar- 
tiles, the first quartile being the low- 
est fourth of the scores. The first and 
fourth quartiles were then combined, 
as were the second and third quartiles. 
These were then correlated with the 
three behavior ratings: Physical Hos- 
tility (PH), Quarrelsomeness (Q) and 
Verbal Hostility (VH). The signifi- 
cance and degree of association are 
shown in Table I. 

All of the overt hostility scales 
showed a low but statistically signifi- 
cant correlation with the hostile Ror- 
schach content. However, only the 
rating of physical hostility was related 
to the hostile Rorschach content at 
the .01 level of confidence. 


TaBLe I—The Relationship Found 
Between the Rorschach Hostility 
Scores and the Overt 


Hostility Ratings 
Chi P 
Variables Square Level = 
Miso” and PFd................ 8.60 01 54 
meme and ©.................... 3.84 05 36 
Ris, and Vi1.................. 5.24 05 Al 


* RHSo indicates that the Rorschach Hostility 
Scale was divided into quartiles with the 
first and fourth quartiles being grouped to- 
gether and the second and third quartiles 
being similarly combined. 


On the basis of the preceding find- 
ing, it was concluded that the first 
hypothesis was confirmed. The Ror- 
schach hostile content displayed the 
predicted curvilinear relationship to 
overt hostility, 


The second hypothesis predicted a 
positive relationship between the hos- 
tile content of the MAPS and overt 
hostility. Three measures of hostile 
content were used in testing this 
hypothesis: the MAPS Hostility Score 
(MHS), the Modified MAPS Hostility 
Score (MMHS), and the Hostility 
Control Score (HCS). All three test 
measures of hostile thematic content 
were divided at their approximate 
medians, as were the three overt hos- 
tility ratings. Each test measure was 
compared with each of the behavior 
scales, using the two-by-two contin- 
gency table. The significance of the 
resulting relationships and their cor- 
relations are presented in Table II. 


The results indicated that, of the 
three methods for evaluating hostile 
content expressed in the MAPS, only 
one was related to the overt hostility 
ratings. Neither the MHS nor the 
MMH scores even approached a sig- 
nificant relationship. ‘The HCS scores 
showed a low but statistically signifi- 
cant correlation with the rating of 
Physical Hostility. The correlation 


TABLE II—The Relationships Between 
Three Measures of Hostile Content 
in the MAPS and the Overt 
Hostility Ratings 






Chi P 
Variables Square Level T* 
iis ang PH.................. 55 .20 
MES and Q................... .20 .20 
MMS and VH................... 20 .20 
MMHS and PH.............. 1.22 .20 
MMHS and Q.................. 62 .20 
MMHS and VH.............. 62 .20 
HCS and PH 01 54 
HCS and Q......... s 10 36 
HCS and VH 10 32 





* Contingency coefficients were not calcu- 
lated for relationships below the 20 per 
cent level of confidence. 

** This value is very near the 5 per cent 
level of confidence of 3.84. 
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TABLE I]J—The Association Between HCS Scores and 
the Overt Hostility Ratings* 











Low 
a, RE OC 3 
I a ce la le 12 


* All variables were divided as close to 


with the rating of Quarrelsomeness 
was slightly under the .05 level of 
confidence. The relationship of the 
HCS scores to the ratings of Verbal 
Hostility fell between the .05 and .10 
levels and thus did not reach an ac- 
ceptable level of confidence. 

This hypothesis, further, required 
that any obtained relationship should 
be positive. The appropriate tabula- 
tion for HCS and the overt hostility 
scales are shown in Table III. 


These results indicated that only 
one of the three methods for evaluat- 
ing hostile content in the MAPS was 
related to overt hostility ratings. HCS 
was very significantly associated with 
the rating for Physical Hostility and 
showed very nearly significant associa- 
tion with the ratings for Quarrelsome- 
ness. All correlations were positive. 
These findings at least partially con- 
firm the second hypothesis of the 
study. 


The third hypothesis to be investi- 
gated predicted that the hostile con- 
tent of the Rorschach and the MAPS, 
when used together, would show a 
stronger relation to overt hostility 
than either measure would by itself. 
This hypothesis was tested by de- 
termining if the quartile division of 
the RHS and the HCS used together 
would correlate higher with the be- 
havior scales than either of these 
measures did singly. Therefore, the 
correlation between the hostile con- 
tent scales was obtained by calculat- 
ing a T from a chi square analysis of 
their relationship as indicated in the 
usual two-by-two contingency table. 
It was found that RHS,g and HCS 
were related at the .10 level of con- 
fidence with a correlation of T = .34. 
The multiple correlation coefficients 





PH VH 


High Low’ High Low High 
1] 3 1] 5 9 


4 9 7 11 5 


their medians as the data would permit. 


of RHS, and HCS on the three be- 
havior ratings were then calculated by 
use of the standard multiple regres- 
sion equation, using the T values in 
place of the conventional Pearson cor- 
relation coefficients. The multiple cor- 
relation coefficients obtained are pre- 
sented in Table IV together with the 
correlations of the individual hostile 
content scales with the behavior vari- 
ables. 


TABLE 1V—The Single and Multiple 
Correlations of RHSg and HCS 
with the Ratings of Overt 





Hostility 
RHSo* -HCS*~——iR,** 
__ SEEN eee 54 54 68 
Q 36 36 4 
WI asscesisnishseaiccsisainsse Al 32 45 


* Degree of correlation indicated by Tschup- 
rov’s Coefficient. 


** Multiple correlation coefficient derived by 
substituting T values for r values. 


From the table it may be seen that 
the third hypothesis is confirmed, 
since the multiple correlation coeffh- 
cients were, in all instances, larger 
than the individual correlations, indi- 
cating that a combined use of the hos- 
tile content of the Rorschach and the 
MAPS did provide a positive increase 
in the relationship. 


DISCUSSION 


Hypothesis 1 which predicted a 
curvilinear relationship between hos- 
tile content on the Rorschach and 
overt hostility is supported by the 
present findings. One way of inter- 
preting this curvilinear relationship is 
to view the Rorschach hostile content 
score as a measure of residual tension, 
i.e., tension which is not acted out in 
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overt behavior or discharged via 
other channels. The data show that 
the individuals who were in the inter- 
mediate group as far as amount of 
hostile content is concerned showed 
both medium and excessive amounts 
of overt hostility. Since the measure 
of overt behavior is the resultant of 
ratings made over a relatively long 
period of time, it would seem that 
these individuals consistently  dis- 
charge some of their hostile tension in 
overt behavior. Consequently, it 
would follow that their tension index 
on the Rorschach would ordinarily 
be in an intermediate rather than a 
high or low range. 

Those subjects who had extremely 
high Rorschach hostile content scores 
expressed relatively little overt hos- 
tility in the classroom. It would ap- 
pear that these subjects were unable 
to utilize behavioral channels for the 
discharge of hostile tension — overt 
hostility may have been too anxiety- 
provoking—and hence the hostile ten- 


sion built up to high levels as revealed 


in the Rorschach hostile content 
scores. 

Those subjects evidencing low hos- 
tile content scores could theoretically 
have been subjects who discharged 
hostile tension immediately and regu- 
larly or who tended to be impunitive 
and to show little evidence of hostil- 
ity arousal in their everyday behavior. 
Since these subjects revealed little or 
no overt hostility in the classroom, it 
would appear that they were relative- 
ly impunitive persons characterized by 
a very low level of hostile tension. 
Consequently, low hostile content 
scores in the Rorschach would be ex- 
pected. 

Regardless of how one interprets its 
significance, however, the curvilinear 
relationship between hostile content 
and overt hostile behavior illustrates 
a significant methodological danger 
that accompanies the use of only two 
extreme criteria groups in studies at- 
tempting validation of projective tests. 
If only the two extreme groups had 
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been used in the present study, no 
significant relationship could have 
been established between hostile con- 
tent scores and overt behavior since 
both the low and high-scoring groups 
displayed little overt hostility. Since 
two-group criteria measures cannot de- 
tect the non-linear type of relation- 
ship established in the present inves- 
tigation, it would seem that studies of 
projective test measures would do 
well to use either the full range or 
several groups representative of the 
range of criteria variables. 

Hypothesis 2, which predicted a 
positive, linear relationship between 
hostile content on the MAPS and overt 
hostility is supported by one aspect of 
the MAPS hostile content. The Hos- 
tility Control Score (HCS) on the 
MAPS was very significantly associat- 
ed with the rating for Physical Hos- 
tility. It may be remembered that 
this score measures the extent to 
which a subject acts out his thematic 
hostility without modifying it. This 
significant relationship, then, would 
appear to substantiate the assumption 
that the stimuli provided by thematic 
materials are in close correspondence 
with real life stimuli and that the 
tendency to respond to these stimuli 
with unmodified hostility is character- 
istic of those individuals who respond 
similarly under real life provocation. 

Although the present study showed 
no significant relationship between 
the MAPS Hostility Score (MHS) and 
the behavior ratings, nevertheless this 
score assumes statistical importance in 
that it affects the reliability of the 
HCS which does show a significant re- 
lationship. 

Hypothesis 3 is also confirmed 
since each of the test measures — 
Rorschach and MAPS — contributed 
equally to a multiple correlation larg- 
er than that obtained from the use of 
either test alone. The findings thus 
provide confirmation of the general 
clinical practice of basing hostility 
evaluations on both the Rorschach 
and a thematic test. 
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This study confirms the validity of 
these hypotheses for the childhood age 
level. However, it may be noted that 
the degree to which these findings can 
be held true for all children of this 
age group is limited by a lack of 
knowledge concerning the degree to 
which these children were a repre- 
sentative sample. The selective effect 
of their reading disability is not defi- 
nitely known. The fact that the group 
showed a normal distribution, both in 
intelligence and amount of overt hos- 
tility displayed, suggests that they do 
not differ markedly from their peers 
in these attributes. Because of their 
reading disability they may have more 
emotional conflicts and somewhat 
higher average hostility as a group, 
but there is no evidence that they 
typically handle their hostility in ways 
that are different from other children. 


SUMMARY 


This study investigated the nature 
of the relationship between overt hos- 
tility displayed by children in their 
schoolroom behavior and the hostile 
content of their Rorschach and MAPS 
protocols. It was hypothesized that: 

1. The hostile content of the Ror- 
schach would show a curvilinear rela- 
tionship to overt hostility. 

2. The hostile content of the MAPS 
would show a positive, linear rela- 
tionship to overt hostility. 

3. The prediction of overt hostility 
could be more accurately made from 
the hostile content of both the Ror- 
schach and MAPS Tests than from 
either test alone. 

The Rorschach and MAPS tests 
were administered to thirty white 
males between nine and fifteen years 
of age. The Rorschach protocols were 
then scored for the amount of hostility 
in the content. The MAPS protocols 
were scored for: (1) the amount of 
hostility produced, (2) the amount of 
hostility produced and the degree of 
its modification, and (3) the degree to 
which hostile content was acted out in 
the stories without modification. 
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Each subject was also rated by his 
teachers on the degree of physical hos- 
tility, verbal hostility, and quarrel- 
someness which he generally displayed 
in the classroom. 

The test and behavior measure of 
hostility were subjected to a statistical 
analysis which revealed the following 
relationships between them: 


1. There was a low but statistically 
significant correlation between the 
hostile content in the Rorschach and 
overt hostility. This relationship was 
essentially curvilinear with high and 
low amounts of hostility being associ- 
ated with low overt hostility and mid- 
range amounts of hostile content being 
associated with high overt hostility. 

2. A positive and statistically sig- 
nificant relationship was found be- 
tween the degree to which hostile 
themes were .acted out without modi- 
fication in the MAPS protocols and 
overt hostility. 

3. A combination of the hostile 
content scores in the Rorschach and 
the MAPS scores based on the acting- 
out of hostile themes without modifi- 
cation produced a multiple correla- 
tion coefficient that was higher than 
the corresponding evaluation of eith- 
er one with overt hostility ratings. 

4, The different relationships found 
between the MAPS and Rorschach 
hostile content and overt hostility in- 
dicated that the two tests were meas- 
uring different aspects of this person- 
ality dimension. 

5. None of the correlations between 
the hostile projective test content and 
overt hostility were high enough to 
make these measures useful as pre- 
dictive instruments on an individual 
level. 


The findings of the present study 
support the validity of each of the 
hypotheses evaluated. 
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Rorschach Form-Level, Intellectual Functioning and Potential ' 


MARVIN SPIEGELMAN 


Evaluation of intellectual function- 
ing has been a routine part of Ror- 
schach interpretation ever since the 
inception of the test, yet research 
aimed at “validating” such intellectu- 


| al estimates has met with only variable 





success. The present paper reviews 
these studies and reports on a study 
in which the previously untested 
technique of form-level rating is used 
to make estimates of both intellectual 
functioning and potential. 


REVIEW 


Hermann’ Rorschach _ postulated 
seven characteristics to be found in 
the protocols of intelligent subjects, 


| on the basis of his study of 120 such 


individuals, (17, pp. 56-66). These in- 
cluded, in brief, an optimum F+% 
(80 to 95), many M, high W%, order- 


| ly sequence both within each card and 


—_— 





throughout the test, low AY% and op- 
timum original responses. These char- 
acteristics refer to the psychological 
functions of clarity of perception and 
association (F+%), capacity for “in- 
ner creation” (many M), ability and 
energy for thought and organization 
(high W%), orderliness and control of 
thinking (sequence), flexibility rather 
than stereotypy (low A%) and opti- 
mum originality within the frame- 
work of good reality-contact (origin- 
als). Rorschach felt that productivity, 
in terms of the number of responses, 
was not relevant in intellectual evalu- 
ation, although some researchers have 
found it to be so. The available 
studies will be summarized below in 
terms of the factors posited by Ror- 
schach, with the addition of studies 
in which the number of responses and 
the Z score of Beck (2) are used. 





* The data for this study were gathered while 

the author was on the clinical psychology 
staff at Fitzsimons Army Hospital, Denver, 
Colorado. 


Number of Responses (R) 


Wishner (24), reports correlations 
significant at the 1% level or better 
between R and Wechsler-Bellevue 
scores on Verbal 1.Q. (.80), Informa- 
tion (.75), Similarities (.53) and Vo- 
cabulary (.61). Spaner (19) finds a 
correlation significant at the 1% level 
between R and Information (.22, 
using epsilon 6 but with no 
other W-B scores. Holzberg’s (5) only 
significant correlation (at the 5% 
level) was between R and Informa- 
tion (.27). Smith (18), on the other 
hand, found near-significant correla- 
tions (.07 level) only between R and 
Comprehension (.46) and Similarities 
(.49). His remaining correlations were 
insignificant (with Full Scale I.Q. .21, 
with Verbal I.Q. .17, with Perform- 
ance I.Q. —.11). Other researchers 
also report insignificant results (21). 
It would thus seem that R or pro- 
uctivity might be related to Verbal 
intelligence, particularly to Informa- 
tion, Comprehension, Similarities and 
Vocabulary may also play a role. The 
differing results might be accounted 
for by the fact that highly intelligent 
subjects sometimes produce only one 
very good response per card, as Ror- 
schach pointed out (17, p. 21). Thus 
the correlations would be non-linear. 


Human Movement (M) 


Low, but consistently positive cor- 
relations of about .25 are found be- 
tween M and the Full-Scale W-B 1.Q. 
Tucker (22), Hertz (4), and Smith 
(18) reported correlations of .26, .25 
and .20, respectively. Again, the cor- 
relation seems to be related only to 
Verbal Intelligence, with Information 
and Similarities providing the heavi- 
est weighting. Smith’s correlations are 
.21 with Verbal 1.Q., .15 with Infor- 
mation, .05 with Comprehension, .23 
with Similarities, .1]1 with Vocabulary 
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and .15 with Performance I.Q. Tucker 
found a significant correlation with 
Information (.33) and Wishner an in- 
significant one with Picture Arrange- 
ment. Lotsof (14) found a correlation 
of .20 between M and the Ohio State 
Test of Intelligence. 


Number and Percentage of Whole 
Responses (#+W and W% 

Beck’s pioneering study (1) showed 
a .47 correlation between W% and 
Binet Mental Age for a feeble-minded 
group. Holzberg found a negative cor- 
relation (—.32) between W%Y% and 
Similarities. Taulbee (21) reported a 
positive and significant correlation 
(5% level) between the number of W 
and Full-Scale W-B I.Q. Wishner (24) 
found a correlation of .74 between 
number of W and Vocabulary (sig- 
nificant at 1% level), but a negative 
correlatiun with Comprehension 
(—.40). These findings are a little 
perplexing in their implications. 
Smith (18) suggests that W is related 
to W-B scores in a U-shape curve, that 
is, those who produce few and many 
W’s are the most intelligent. Ror- 
schach, of course, felt that W-produc- 
tion was related to the “availability 
of associations” and the availability 
of “energy of associative activity” (17, 
pp- 65, 66). A major difficulty fre- 
quently pointed out (notably in 
“Methodological Research Problems” 
in 12), is that such “scores” as W 
“merely indicate the fact that the sub- 
ject was trying to use all the blot 
material on any given card. . . Obvi- 
ously, any attempt to attach more 
meaning than that to a W% would 
be a premature.” It is pointed out 
that a high WY might be produced 
by a subject with a cortical lesion 
which reduced his intellectual flex- 
ibility, by a gifted person with a rich 
imagination, by a person with medio- 
cre intelligence who does not know 
the limits of his reasoning power, by 
children, by people with undifferen- 
tiated perception, etc. What, perhaps, 
is related to intelligence is the degree 
of complexity, differentiation and or- 


ganization found in the W responses. 
This information is not provided by 
either the W% or the number of 
W, in the absence of knowledge of the 
type and quality of the W responses. 


Proportion of Responses with 
“good form” (F+-%) 


Hertz (4) reported correlations be- 
tween intelligence and F+% which 
vary between .33 and .64, the latter 
figure coming from Beck’s work (1), 
but a more recent study found a cor- 
relation of only .08 (24). Holzberg 
(5) found a significant correlation of 
F+ with Similarities only (.36) and 
Spaner (19) a significant correlation 
only with Comprehension (epsilon 
square of .24). Taulbee, on the other 
hand (21), found no significant rela- 
tionships at all. In the opinion of the 
author, the use of F+%, as now 
measured, results in difficulties sim- 
ilar to that found in the use of W% 
(20). F+ is scored for both popular 
level responses and superior ones, 
which vitiates its use as an intellectual 
measure. It is more likely to give in- 
formation about the state of the sub- 
ject’s reality-testing. The positive re- 
sults obtained would suggest that per- 
haps Rorschach’s hypothesis about the 
“clarity of perception and _associa- 
tion” may have some merit, but that 
F+¥% alone is not likely to measure 
intellectual functioning. 


Proportion of Animal 
Responses (A%} 


Rorschach believed that a high 
proportion of animal responses was 
indicative of stereotypy and negative- 
ly related to intelligence. This is 
borne out by Beck (1), who found a 
correlation of —.41 between A% and 
mental age. Other researchers have re- 
ported both negative (19) and posi- 
tive (18) correlations of A% with 
Object Assembly, but with no other 
sub-tests. Rorschach’s hypothesis 
seems to have received insufficient 
testing, though most workers would 
agree with his statement. 
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Beck’s Z 


Beck empirically established an “or- 
ganization” or Z score which he post- 
ulated as closely related to intellectual 
functioning (2). Taulbee (21) ob- 
tained a significant correlation of Z 
with Full Scale W-B 1.Q. and Wish- 
ner (24) found highly significant cor- 
relations with W-B I.Q. (.54), Verbal 
I.Q. (.42), Information (.36) and 
Vocabulary (.60). These studies sug- 
gest that Z is a measure of Verbal 
Intelligence, related primarily to In- 
formation and Vocabulary. 


Content Categories and 
Original Responses 


Only two studies report correla- 
tions between these two factors and 
psychometric measures. Spaner (19), 
using epsilon square, found a signifi- 
cant correlation between W-B Full 
Scale 1.Q. and number of content 
categories and Smith (18) found the 
number of originals provided the 
highest of his correlations with I.Q., 
though it was low (.22). There is a 
suggestion here that flexibility (vari- 
ety of content categories) and origin- 
ality, do relate to 1.Q., but the rela- 
tionship has been insufficiently as- 
sessed. 


Other Measures and Results 


Studies done abroad, (6, 13, 16, 
available only in abstract form), re- 
port both significant and non-signifi- 
cant correlations between various 
Rorschach measures and psychometric 
devices, and reflect the same concern 
with the adequacy of quantification. 
Factor analytic studies of the Ror- 
schach (23, 14) have suggested the 
presence of an “intelligence factor.” 
In two researches, (21, 3), quantifica- 
tion and correlation were essentially 
not significant, but clinicians using a 
more “global” approach were able to 
predict I.Q., although there were 
marked individual differences in the 
accuracy of their predictions. 


Discussion 
No clear-cut conclusions can be 
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drawn from the results of the above- 
mentioned studies. Although all of 
Rorschach’s factors have shown sig- 
nificant correlations with psychomet- 
ric I.Q. measures in some researches, 
in others all have failed to do so. This 
is also true for the factors of R and 
Z. Where significant correlations are 
found, they are exclusively with Ver- 
bal Intelligence and, in the W-B, with 
the subtests of Information, Similari- 
ties, Vocabulary, and Comprehen- 
sion. We have seen that individual 
clinicians, using a “global” approach, 
are able to predict I.Q. scores from 
their assessment of the Rorschach. 
The lack of adequate correlations 
may indicate that the factors are in- 
adequate, not that no relationship 
exists. R, Number of W, W%, and 
F+4%, each involve several sub-factors 
which, when used in gross fashion, 
tend to cloud’ the issue (20). Beck’s Z 
seems to show promise, but it meas- 
ures only one of Rorschach’s group 
of characteristics of intelligence, 
namely organization. A%, Number of 
Content Categories, and Original re- 
sponses, seem to be related to two 
other factors of flexibility and orig- 
inality, but are limited as quantified 
measures. M, which is related to “in- 
ner creation”—perhaps measures only 
one aspect or one kind of intelli- 
gence. 

It should be noted that Rorschach 
studied the common characteristics of 
records of intelligent subjects, Later 
studies, however, have implicitly as- 
sumed that his factors were continu- 
ous—the higher the intelligence, the 
more the factors would be present. 
Research suggests that the latter as- 
sumption may be correct, but this has 
not been clearly demonstrated. Per- 
haps other factors which characterize 
unintelligent subjects should be in- 
troduced. 


An important defect of the factors 
is that none of them are “scores.” 
Ainsworth and Klopfer (11, p. 19) 
have pointed out that, “In the Ror- 
schach technique scoring is a process 
of classification. Responses that are 
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similar with respect to some signifi- 
cant characteristics are classified to- 
gether and assigned the same scoring 
symbol. The only score that is 
directly quantitative is form-level rat- 
ing.” This point was later re-empha- 
sized and expanded (‘Methodological 
Research Problems” in 12). Statistical 
errors result from the comparison, by 
correlation, between a true set of 
“scores,” as in the Wechsler-Bellevue, 
with Rorschach “scores’’ where the 
latter have a different semantic mean- 
ing. 

One is left with the impression that 
there may well be a relationship be- 
tween psychometric intellectual meas- 
ures and Rorschach factors, but the 
degree and type of relationship has 
not been precisely determined. The 
Rorschach, for example, may assess 
different aspects of intellectual func- 
tioning than those revealed by psy- 
chometric devices. 

The variable of potential intelli- 
gence, in particular, is commonly ex- 
amined in Rorschach testing, but only 
rarely so in I.Q. tests. Evaluation of a 
subject’s intellectual capacity, under 
optimum conditions, as well as eval- 
uation of his current intellectual 
functioning is stressed by Klopfer (9, 
11), yet there have been no studies to 
assess the validity of such estimates. 

What appears to be needed is an 
objective method of appraising in- 
tellectual functioning in the Ror- 
schach which can include several of 
Rorschach’s factors, can be quantifi- 
able in the sense that I.Q. tests are, 
and can be used to study such vari- 
ables as potential intelligence. The 
form-level rating seems to be such a 
method. 


ForM-LEVEL AND POTENTIAL 
INTELLIGENCE 


In 1944, Klopfer and Davidson pub- 
lished a method of “objectifying one 
area of Rorschach interpretation — 
namely, the area of intellectual func- 
tioning as expressed in the form- 
level.” (9, 10). This method is essen- 
tially a scaling device which was “in- 


tended to supplement the usual psy- 
chometric procedures which, by them- 
selves, give a more precise estimate 
of the intellectual efficiency level.” 
The method involves the quantitative 
evaluation of each response in a rec- 
ord on certain form-qualities, namely 
accuracy, specification, and organiza- 
tion. Klopfer and Davidson noted that 
earlier attempts at evaluation of form- 
quality (e.g., Beck’s Z, Hertz’s “g’’) 
were either too gross or assessed only 
one of the three factors thought to be 
important. The scale ranges from 
—2.0 to +5.0, with intervals of 0.5. 
The method allows for additions and 
subtractions for accuracy, specifica- 
tions and organization. 

Investigation found that the assess- 
ment of form-level was, perhaps, not 
as objective as was first imagined (7, 
8), since the reliability of agreement 
was not adequate. Methodological dif- 
ficulties were found in the reliability 
investigation, however. The Ror- 
schachs used were found to be in- 
completely administered and had, as 
Klopfer called them, “empty shells of 
responses.” Subsequent elaboration 
and refinement of the form-level rat- 
ing (11) has not been re-examined 
from the point of view of reliability. 

Form-level assessment, if reliable, 
may constitute the desired objective 
method of appraising intellectual 
functioning in the Rorschach, but no 
research has yet been undertaken in 
this regard. The method is quantifi- 
able, in the sense that I.Q. tests are, 
it includes several of Rorschach’s fac- 
tors, and permits assessment of such 
variables as potential intelligence. 

It is hypothesized (11) that the 
average form-level of a record pro- 
vides a measure of intellectual effi- 
ciency which is related to I.Q. and 
that the response having the highest 
form-level in a record, provides an 
index of intellectual potential. 


Evaluation of potential intelligence 
by means of the Rorschach has had, 
until recently, no satisfactory coun- 
terpart in psychometric testing. Vari- 
ous methods of weighting Wechsler- 
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Bellevue sub-test scores have been at- 
tempted, using the highest sub-test 
score as an index, for example, but 
theoretical and methodological prob- 
lems have made these methods unsat- 
isfactory (15). Mahrer (15), working 
within the context of Rotter’s social 
learning theory, has applied the con- 
cept of behavior potential to Wech- 
sler-Bellevue administration and has 
derived a means of measuring poten- 
tial intelligence. This method in- 
volves the repeated questioning of 
subjects on the Wechsler-Bellevue, 
using the largest number of correct 
answers as an indication of intellect- 
ual potential. The Mahrer method 
and the routine method of adminis- 
tration of the Wechsler-Bellevue were 
applied to subjects used in the pres- 
ent study. 


RESEARCH 
Hypotheses 


The present study investigates the 
relationship between intellectual eval- 
uation by means of Rorschach form- 
level assessment and _ psychometric 
I.Q. assessment as given in the Wech- 
sler-Bellevue Intelligence Scale (Ver- 
bal Scale). The major hypotheses are 
as follows: 

1. A high positive correlation will 
obtain between the average 
form-level in subjects’ Rorschach 
records and Wechsler-Bellevue 
Verbal Scale I.Q. Scores. 

2. A high positive correlation will 
obtain between the response 
with the highest form-level in 
subjects’ Rorschach records and 
the highest Wechsler-Bellevue 
Verbal Scale I.Q. scores as meas- 
ured by the Mahrer method. 

Some additional relationships are 
examined. These are the correlations 
between various W-B sub-tests and 
form-level, the relative correlation of 
human movement responses (M) and 
the number of responses (R) with 
W-B scores. 


Method 
The subjects of this investigation 
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included 120 consecutive patients re- 
ferred for psychological testing to the 
Clinical Psychology Section of Fitz- 
simons Army Hospital, exclusive of 
military prisoners, children, and cases 
requiring immediate evaluation for 
dispositional purposes. The mean age 
of the subjects was 26 years (with a 
SD of 8 years). There were 106 male 
and 14 female patients. All referrals 
were made by the psychiatric and 
medical staff of the hospital without 
awareness of the nature of the re- 
search project. One hundred and 
twelve subjects were military person- 
nel and 8 were dependents of military 
personnel. Fourteen were out-patients 
and 106 were in-patients. The dis- 
charge diagnoses of the patients were 
grouped as follows: No disease (N = 
6), Neuroses (N= 18), Character Dis- 
orders (N=27), Schizophrenia (N= 
27), Other Psychoses (N = 10), Schiz- 
oid and Paranoid Personality (N = 
18), Organic Brain disease or damage 
(N = 14). 

All 120 patients were administered 
a Rorschach (by the author) and a 
standard Wechsler-Bellevue (by Mah- 
rer) including the Verbal sub-tests of 
Information, Comprehension, Arith- 
metic, Similarities and Vocabulary. 
Digit Span was omitted for reasons 
which are inherent in the Mahrer 
method, discussed in (15). The Verbal 
sub-tests included have been employed 
in studies cited earlier in this paper. 

The order of administration of the 
Rorschach and Wechsler-Bellevue was 
randomized and neither examiner 
knew the scoring results on the other 
test until the scores had been record- 
ed. Sixty patients were given a second 
Wechsler-Bellevue, using the Mahrer 
method to assess potential I.Q., while 
the remaining sixty were given a 
standard readministration of the W-B 
and served as controls, Patients were 
selected for experimental or control 
groups on the basis of initial 1.Q., so 
the two groups had equivalent aver- 
age intelligence and standard devia- 
tions. The Rorschachs were scored for 
form-level by the author and the 
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TABLE I. Correlations Between Rorschach and Wechsler-Bellevue 
Measures of Functioning Intelligence 





N = 120 
Wechsler-Bellevue 
Verbal Infor- Compre- Arith- Simila- Vocabu- 
Rorschach 1.Q. mation hension metic rities lary 
Average Form-Level............ = 55 29 16 .00 .00 By 
Number of Responses (R) 32 30 37 13 .20 42 
Number of Human Movement (M)....__.30 24 30 18 24 03 


Note: For 119 df, 5% level of significance requires .176, 1% level requires .234. 


Wechsler-Bellevues were scored by 
Mahrer. 


Reliability 


Twelve records, with a total of 223 
responses, were randomly drawn from 
the group of 120 Rorschach records, 
and independently scored for form- 
level rating by Bruno Klopfer.2 A 
comparison of the scoring showed per- 
fect agreement on 86% of the re- 
sponses. Of the 14% in which dis- 
agreement occurred, 81% involved 
discrepancies of 0.5 and 19% of 1.00. 
It may be concluded that form-level 
rating is a reasonably objective and 
reliable procedure, 

Reliability of Mahrer’s Wechsler- 
Bellevue scoring was based upon rec- 
ords drawn randomly from his ex- 
perimental and control groups, three 
for each. These records were inde- 
pendently scored by seven judges. 
Over-all reliability of agreement was 
9. 


Results 


The results with regard to average 
form-level, number of responses and 
number of human movement re- 
sponses are given in Table I. It is 
seen that all three Rorschach meas- 
ures correlate with Wechsler-Bellevue 
Verbal 1.Q. at the 1% level of sig- 
nificance or beyond. The correlation 
of .55 between average form-level and 
Verbal I.Q. is significantly larger (6% 
level) than for either R (.32) or M 
(.30) with I.Q, An examination of 
the sub-test correlations reveals that 
average form-level correiates highest 





2? Thanks are extended to Dr. Bruno Klop- 
fer for kindly giving his time for this rating. 


with Vocabulary (.57), yet significant- 
ly with Comprehension (.46) and In- 
formation (.29), but insignificantly 
with Arithmetic and Similarities (both 
0.00). R shows similar, though small- 
er, correlations with the subtests with 
the exception of Similarities, with 
which it correlates .20 (5% level). M, 
on the other hand, shows a rather dif- 
ferent distribution, correlating at the 
1% level with Comprehension (.30), 
Similarities (.24) and Information 
(.24), at the 5% level with Arithmetic 
(.18), and insignificantly (.03) with 
Vocabulary. The correlation between 
M and both Similarities and Informa- 
tion is consistent with previous re- 
search, but the low correlation with 
Vocabulary was unexpected. 


The results tend to confirm hypo- 
thesis 1: a high positive correlation 
obtains between the average form- 
level in subjects’ Rorschach records 
and Wechsler-Bellevue (Verbal Scale) 
I.Q. scores, The correlation of .55, 
though highly significant, seems to 
be insufficiently high for accurate 
individual prediction. Klopfer and 
Ainsworth, however, suggest using a 
group of factors in assessing intel- 
lectual functioning, including aver- 
age form-level, number and quality 
of M, and the number of responses, 
among others. In the present study, 
correlations between average form- 
level and R was found to be .37, with 
M, .54. R correlated at .31 with M. 
A multiple correlation of the three 
Rorschach factors with Verbal I.Q. 
(Doolittle method) yielded a coeffi- 
cient of .65. This would suggest that 
the Klopfer method of individual in- 
tellectual assessment by using a vari- 
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ety of factors may be quite tenable. 
This, of course, is what Rorschach 
originally proposed. Form-level, how- 
ever, appears to be the best single 
measure in this regard and the most 
feasible. Since half of the subjects 
failed to produce any M, linearity 
cannot be assumed and the use of the 
Pearson r is questionable. M is an 
essentially qualitative factor to be 
used in the manner that original re- 
sponses are used in assessing intel- 
ligence. 

The efficacy of the average form- 
level in predicting I.Q. was further 
investigated by dividing the subjects 
into three groups, 40 each, on the 
basis of the lower third (I.Q. 64-91), 
middle third (I.Q. 92-107), and up- 
per third (I.Q. 107-138), The resul- 
tant correlations between average- 
form level and I.Q. were .29 for the 
lower third, .34 for the middle third, 
and .40 for the upper group. It would 
appear that the predictive value of 
the form-level scoring improves as 
1.Q. increases. 

When the group is similarly divided 
into thirds on the basis of I.Q. and 
the groups are correlated with the 
number of responses, the results are 
0.00 for both the lower and middle 
thirds and .19 for the upper third. 
When M is used, the results are .07 
for the lower third, 0.00 for the mid- 
dle third, and .18 for the upper third. 
Apparently neither M nor R can be 
effectively used for even gross indi- 
vidual prediction by themselves. 


With regard to hypothesis 2; a high 
positive correlation will obtain be- 
tween the response with the highest 
form-level in subjects’ Rorschach rec- 
ords and the highest Wechsler-Belle- 
vue (Verbal Scale) 1.Q. scores, as 
measured by the Mahrer method. The 
obtained correlation was .52, signifi- 
cant beyond the 1% level. The cor- 
relations of high-form-level with the 
various subtests were as follows: with 
Information .57, with Comprehen- 
sion .56, with Arithmetic .45, with 
Similarities .65, and with Vocabulary 
56. Arithmetic shows the smallest 


341 


correlation, but it, too, is statistically 
significant. The sub-test correlations 
are relatively unvaried, however, and 
it would seem that potential intel- 
ligence as measured by the Mahrer 
method has a good deal of similarity 
to potential intelligence as measured 
by Rorschach high form-level. 


Discussion 


The results of this study, with re- 
gard to the role of form-level in the 
assessment of intellectual functioning 
and potential, suggest certain modi- 
fications of the form-level rating scale. 
It was found that the average form- 
level was much less effective in pre- 
dicting I.Q. scores among I.Q.’s be- 
low 100 than it was with I.Q.’s above 
100. Frequently, subjects with below 
average intelligence could barely meet 
the requirements of the popular-level 
1.00 response throughout their rec- 
ords. The undifferentiated 0.5 and 
0.0 type of response was not as fre- 
quent in such records as might be ex- 
pected. Improved predictive value 
might be accomplished by modifying 
the scale for values below 1.00, so 
that it is more sensitive in the lower 
ranges. It was noted that the aver- 
age form-level ratings correlated at 
0.00 with both Arithmetic and Simil- 
arities sub-tests. It is the impression 
of the author that the abstractive 
function measured by these subtests 
is insufficiently weighted in the form- 
level rating. Additional credit or finer 
differentiation of the “organization” 
value of .5 could conceivably raise 
the correlation. 

Of some promise is the comparison 
between the Mahrer method for as- 
sessing potential intelligence on the 
Wechsler-Bellevue and the usual Ror- 
schach form-level method. Better val- 
idating criteria for both might be 
provided by a predictive study in 
which some intervening events (e.g., 
psychotherapy) might produce an in- 
crease in I.Q. 

The practical use of form-level in 
1.Q. assessment, however, is of less 
importance, in the author’s opinion, 
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than its use in objectifying commonly 
used clinical concepts. Klopfer* de- 
fines form-level as indicating “the 
combined result of reality-testing and 
active mastery of reality. The general 
fit of stimulus material and concept 
indicates more the former; degree and 
control of specification and organiza- 
tion indicates more the latter.’” Klop- 
fer hypothesizes, and this research 
supports, that functioning and poten- 
tial intelligence are related to aver- 
age and high form-level, respectively. 
The relationships between intelli- 
gence, reality-testing, and mastery, 
however, need to be explored. 


SUMMARY 


This paper reviewed the literature 
on the assessment of intelligence in 
Rorschach interpretation as compared 
with I.Q. testing. A study of the pre- 
viously unevaluated technique of 
form-level rating in such interpreta- 
tion was reported. One hundred and 
twenty neuro-psychiatric subjects were 
given a standard Wechsler-Bellevue 
(Verbal Scale) and a Rorschach. A 
correlation of .55, significant beyond 
the 1% level, between average form- 
level and I.Q. was found, which was 
significantly higher (6% level) than 
the correlations between the number 
of responses and I.Q. (r is .32) and 
the number of human movement re- 
sponses and I.Q. (r is .30). A com- 
parison of these three Rorschach 
measures and Wechsler-Bellevue sub- 
tests was also performed. The correla- 
tion between average form-level and 
intelligence was seen to increase with 
increase in I.Q. The lower correla- 
tion among lower I.Q.’s was thought 
to be a result of the lack of refine- 
ment of the rating scale in the lower 
values. Potential intelligence, as 
measured by high form-level on the 
Rorschach, correlated at .52 (1% 
level) with potential intelligence as 
measured by the Mahrer method on 
the Wechsler-Bellevue. 





® Personal communication. 


Rorschach Form-Level, Intellectual Functioning and Potential 
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Reliability of Responses to Pictures of Peers *” 


Wise B. WEBB 
AND 
CARROLL E., Izarp # 
U. S. Naval School of Aviation Medicine 


The meaningfulness of subjects’ re- 
sponses to photographs of human faces 
has been explored by Beier (1), Izard 
(2) and others. The present study ex- 
amines various aspects of the reliabil- 
ity of such responses. Positive results 
should encourage further use of the 
medium under consideration as a tool 
for studying interpersonal responses. 


PROCEDURE 


One hundred and ten naval avia- 
tion cadets were presented 157 pic- 
tures of faces of randomly selected 
cadets. ‘I’hese were presented on slides 
and projected on a large screen. To 
our knowledge, none of the subjects 
was known to the experimental group. 
To each picture the cadet was asked 
to mark on a four choice multiple- 
choice form whether “ (a) he was very 
favorably impressed by the picture, 
(b) he was mildly favorable to the 
picture, (c) he received slightly un- 
favorable impression from the picture; 
or (d) the picture made a very unfa- 
vorable impression.” 


One week later the subjects were 
asked to rerate the same set of pic- 
tures. 


The “favorableness” of response of 
an individual to the 157 faces pre- 
sented him was obtained by summing 
the total number of responses that 
each subject gave in the categories 
“very favorably impressed” and “mild- 





* This paper was developed as a part of 
ONR Contract NR154-098. Opinions and 
conclusions are those of the authors. They 
are not to be construed as necessarily re- 
flecting the view or the endorsement of the 
Navy Department. 

*The authors wish to offer their thanks to 
Edward J. Wallon for his aid in statistical 
computations. 


* Now with General Electric Company. 


ly favorable” and subtracting from 
these the total number of unfavorable 
responses (the items marked “slightly 
unfavorable” and the items marked 
“very unfavorable’). Thus, if a per- 
son responded favorably to 100 pic- 
tures and unfavorably to 57 pictures 
his score would be 43. 

The “intensity’” of response of a 
given subject was obtained by sum- 
ming the two extreme responses which 
could be made to each item, i.e., the 
categories “very favorably impressed” 
and “very unfavorable” and subtract- 
ing from these responses the less in- 
tense response categories, i.e., those 
items marked “mildly favorable” and 
those marked “slightly unfavorable.” 
By such a method, if a person re- 
sponded to more than half the re- 
sponses using the extreme categories 
he would have a plus score and if he 
responded more frequently in the 
two middle categories he would have 
a minus score. 


RESULTS 


We were first concerned with the 
question of the stability of favorable 
or unfavorable reaction tendencies to- 
ward faces of peers, both within a 
given session and between sessions. By 
using an odd-even split-half procedure 
(corrected by the Spearman-Brown 
formula), it was found that the within 
session reliability was .92 for the fa- 
vorability score. The between session 
reliability was obtained by simply 
correlating the favorableness scores 
obtained for the two sessions; this re- 
liability was .56. It would appear then 
that individuals react with a consider- 
able consistency of response over a 
series of 157 randomly selected faces 
within a given session, In other words 
if a person responds highly favorably 
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to a set of faces he is also very likely 
to respond favorably to another set of 
faces. There is still considerable sta- 
bility of this tendency a week later, 
although there has been a consider- 
able drop in consistency. 

A similar stability was noted in re- 
gard to the intensity of an individual’s 
reaction to faces. Using the intensity 
score, the within session reliability ob- 
tained by an odd-even procedure was 
.93 and the between session reliability 
was .72. Again, if a person responds 
with extreme responses to one set of 
pictures he is likely to respond with 
similar “extremeness” to another set. 

It was noted that generally individ- 
uals respond favorably to faces of 
their peer group. The mean number 
of favorable responses given in the 
first session was 110.68 and the mean 
number of unfavorable responses was 
46.31. This would indicate that a nor- 
mal group of subjects, when forced to 
respond, respond favorably to about 
2 out of every 3 faces of their peers. 
It was found that on the first test the 
average number of “mild reactions” 
was 99.5 and the average number of 
“extremely” favorable or unfavorable 
reactions was 57.4. This would indi- 
cate that in general one’s reaction to 
the face of others is described as mild 
in somewhat more than 2 times out 
of every 3. 

In addition to the findings noted 
above, perhaps one of the most strik- 
ing findings was evidence of a stereo- 
typing of responses on the part of the 
total group toward faces presented 
them. The papers were divided into 
two randomly selected groups. The 
rank order of the “favorableness” of 
the pictures was obtained by totaling 
up the number of favorable responses 
that each picture received for the 
total group and ranking the pictures 
on the basis of the favorable responses 
received by each face, The correlation 
between the rank orders for the two 
halves of our subjects was .92, which 
reveals a rather startling “stereotyp- 
ing” of responses to pictures of peers. 
In a sense, this means that if a picture 
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is viewed unfavorably by half of a 
population, it is almost certainly to 
be viewed with similar unfavorable- 
ness by a second half of the popula- 
tion. One receives the impression then, 
that there is “built” into the group a 
relatively stable and universal initial 
reaction tendency to the faces of peers. 

A final point of interest was ex- 
plored. The relationship between the 
intensity of response and the favor- 
ability of response was noted. Each in- 
dividual could be scored on the fa- 
vorableness of their responses to the 
pictures and could also be scored as 
to the extent to which they used the 
extreme or the middle categories in 
such responses. These two scores were 
correlated for our group. The correla- 
tion was found to be —.28. This would 
indicate that the more extreme the 
rating the less favorable the rating 
was. . 


SUMMARY AND CONCLUSIONS 


A group of 110 naval cadets were 
presented pictures of 157 other cadets 
with whom they were not personally 
acquainted. They were asked to record 
whether each picture impressed them 
very favorably, mildly favorably, mild- 
ly unfavorably, or very unfavorably. 
We have then a group of young men 
(ages 18 to 25) responding to the pic- 
tures of their peers in age, interest, 
and general background. 

The consistencies of response in this 
situation were marked, Within ses- 
sions the responses of a subject on half 
the pictures were highly predictive of 
his responses to a completely different 
group of pictures. With a week be- 
tween sessions, responses of a subject 
during one period were highly pre- 
dictive of his responses at a later pe- 
riod. This high consistency was true 
of both the degree of favorableness 
expressed toward the group of pictures 
and the intensity with which these re- 
sponses were expressed. 

Perhaps the most striking consist- 
ency was noted in the way the group 
as a whole responded to a given pic- 
ture. Some faces were almost univer- 
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sally responded to favorably, others 
unfavorably. If, for example, we 
ranked the pictures by the number of 
persons responding to each picture fa- 
vorably on the basis of the responses 
of half the raters, the ranking was 
highly correlated with such a ranking 
based on the other half of the raters. 

Let us recall that the faces of others 
as a stimuli are a complex cumulated 
history of social and interpersonal ex- 
periences. Few stimuli are as discrete- 
ly associated with socially mediated 
rewards and punishments as the hu- 
man face. These facts plus the experi- 


mental reliability of this response 
demonstrated in this paper should 
enhance the consideration of this re- 
sponse as an experimental variable. 
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Sexual Connotation of the Name Blacky 


WILLIAM WOLFSON AND FRANCES WOLFF 
Middletown State Hospital 


In his manual for the Blacky Pic- 
tures, Blum (1, p. 3) states: “The 
names Blacky and Tippy were select- 
ed by means of an informal survey in 
which a list of eight dog names was 
shown to a small group of males and 
to a small group of females. All the 
persons were asked to record whether 
they felt that each name suggested the 
male sex or the female sex. Generally 
the male judges felt “Blacky” to be 
male, whereas the female judges re- 
garded it as female. “Tippy” ... has 
his (her) sex described equally often 
as male or female by both male and 
female judges.” If “Blacky” is not a 
sexually neutral name, the question 
arises as to the comparable degree of 
identification afforded by the stimulus 
word to either sex. 

To test the hypothesis of the sexual 
neutrality of the dog name “Blacky” 
169 subjects were individually asked 
to indicate the sex for each of eight 
dog names, including “Blacky” and 
“Tippy,” presented on cards in ran- 
dom order.! The subjects were 38 nor- 
mal males, 60 normal females, 34 male 
psychiatric patients, and 37 female 
psychiatric patients. All were white 
and between 18 and 60. 


in that both male groups overwhelm- 
ingly classified “Blacky” as male. This 
is significant at the .01 level. However, 
contrary to Blum, both female groups 
also reflect the same significant de- 
gree of male connotation for “Blacky.” 
The name “Tippy” was found to be 
sexually neutral in connotation for all 
groups except female patients. This 
group classified “Tippy” as primarily 
male, a preference significant at the 
.05 level. 

It would seem from the data that 
the dog name “Blacky” does not, of 
itself, present a sexually flexible stim- 
ulus but is predominantly male in 
connotation. ‘How much this factor 
is operative in the actual clinical sit- 
uation remains to be explored. 


SUMMARY 


In this study it was shown that the 
dog name “Blacky” by itself, was not 
sexually neutral as Blum implied but 
that “Blacky” was predominantly male 
in connotation irrespective of the sex 
of the rater. This held for psychiatric 
patients as well as normals. No at- 
tempt was made to see how much of 
a factor this was in the actual utiliza- 
tion of the Blacky Pictures. 


TABLE I—Sexual Classification of Blacky and Tippy by Groups 


Group 
Normal Male. 
Normal Female 
Patient Male 











ee ae 


The data in Table I supports 
Blum’s findings with respect to males 





*The other dog names used were: Pal, 


Ranger, Jinx, Spotty, Wooly, and Fluffy. 





Blacky Tippy 
Male Female Male Female 
30 8 18 20 
50 10 29 31 
a 8 15 19 
was 6 25 12 
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Conception of Masculine and Feminine Roles 
in Paranoid Schizophrenia * 


ABRAHAM M. ZEICHNER 
Fairfield State Hospital 


In a previous paper by the author 
(12), an attempt was made to inves- 
tigate the hypothesis relating para- 
noid schizophrenic states to conflict 
over latent homoerotic drives. The 
results obtained by the study led to 
a formulation relating the homosex- 
ual position to the adaptive functions 
implicit in the various stages of psy- 
chosexual identification. To summar- 
ize briefly, the results suggested: a) 
that the paranoid schizophrenic group 
studied revealed more marked tend- 
encies toward feminine psychosexual 
identification than either the control 
schizophrenic group, consisting of 
catatonic and hebephrenic individ- 
uals, or the control normal group; 
b) that the non-paranoid schizophre- 
nic group tended toward greater fem- 
inine identification than the normal 
group; c) that the non-paranoid 
schizophrenic group revealed greater 
confusion in psychosexual identifica- 
tion than either the paranoid group 
or normal group; d) that the paranoid 
group tended toward greater psycho- 
sexual confusion than the normal 
group. 

In attempting to integrate these re- 
sults, it was suggested that the homo- 
erotic position may represent efforts 
on the part of the conflicted indi- 
vidual to resolve the confused psycho- 
sexual identification which is so de- 
vastating to the ego and represents 
a more regressed level of stabilization 
than does a homosexual resolution 
via feminine identification. This may 
in part account for the clinical ob- 
servation that the paranoid schizo- 





1 This is the second article based upon a dis- 
sertation submitted in partial fulfillment of 
the requirements for the degree of Doctor 
of Philosophy in the School of Education of 
New York University. 


phrenic is generally more stable, and 
his ego functions more intact, than 
catatonic and hebephrenic _ schizo- 
phrenics. It was further suggested 
that elements of confused identifica- 
tion and identification with the op- 
posite sex may occur in all individ- 
uals. The nature of the final adjust- 
ment depends upon the patterns that 
emerge in the ego’s process of estab- 
lishing and maintaining a state of 
relative equilibrium. 


Dependent upon the developmental 
aspects of identification generally, 
and _ psychosexual identification in 
particular, is the issue of concept of 
social role. If identification represents 
an important facet of the substratum 
of character structure, then the social 
role constitutes a major aspect of the 
resultant expression of the basic char- 
acter structure of the individual. In 
effect, the social role of the individ- 
ual is an important index of the ad- 
justive value of his identifications. 
Cameron (3, p. 90) stated, “ ... a 
person’s role-taking habits are of very 
great significance because defects, dis- 
tortions and exaggerations in their 
operation can give rise to all kinds 
of damaging behavior pathology, es- 
pecially in adolescent and adult life.” 

A number of investigators, in their 
studies of the prepsychotic personality 
of the individual in terms of the sub- 
sequent reaction that develops, re- 
ferred to variables clearly related to 
social role. Blalock (1) reported 
passivity, submissiveness, and general 
lack of sexual adaptability as premor- 
bid characteristics of catatonic schizo- 
phrenics. Sadler (10) cited feelings 
of inadequacy, suspiciousness and 
jealousy, inordinate ambition, pru- 
dishness, vanity, impracticality, and 
self-seeking as characteristics of indi- 
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viduals who tend to develop para- 
noid reactions, 

A question that would seem logi- 
cally to follow the conclusions con- 
cerning psychosexual] identification in 
paranoid schizophrenics, non-para- 
noid schizophrenics, and clinical nor- 
mals is whether these groups tend 
also to differ in their concept of the 
masculine and feminine roles. 


STATEMENT OF THE PROBLEM 


Given the understanding of the re- 
lationship between psychosexual iden- 
tification and psychopathology, some 
ambiguity still remains. What differ- 
ences should be expected between an 
individual with predominantly fem- 
inine identification whose concept of 
the feminine role is cast in terms of 
an aggressive, assertive, domineering 
figure and an individual with fem- 
inine identification who views the fe- 
male figure as passive, submissive and 
so forth? In this study some aspects 
of the differences in conception of 
the masculine and feminine roles 
among paranoid schizophrenics, non- 
paranoid schizophrenics, and normals 
will be investigated. 

It is hypothesized: 

1. That the paranoid and non-para- 
noid schizophrenic groups will differ 
significantly from the normal group 
With respect to concept of the mascu- 
line and feminine roles. 

2. That the paranoid schizophrenic 
group will not differ significantly 
from the non-paranoid group with 
respect to concept of the masculine 
and feminine roles. 


SUBJECTS 


_ The data descriptive of the sub- 
jects were reported more systemati- 
cally in a previous publication (12). 
All the subjects were veterans of 
World War II. The experimental 
group consisted of fifteen paranoid 
schizophrenic, hospitalized patients. 
The non-paranoid control group con- 
sisted of eight catatonics and seven 
hebephrenics. The normal controls 
consisted of fifteen patients post-op- 


349 


eratively hospitalized. Equivalence of 
the groups for age and education 
was established. 


PROCEDURE 


The Rorschach Psychodiagnostic 
Test and the Thematic Apperception 
Test were the experimental instru- 
ments used for this study. 

I. Rorschach Psychodiagnostic 
Test. The administration of the Ror- 
schach was described fully in the pre- 
vious study (12). Briefly, the test was 
first administered in the manner pre- 
scribed by Klopfer and Kelley (7). 
Testing the Limits for Sex (9) fol- 
lowed. The third step consisted of 
Testing the Limits for Human Move- 
ment, a modification of Testing the 
Limits for Sex. Human movement re- 
sponses, for this aspect of the study, 
were scored in the following manner: 


1. Movement Responses in Male 
Figures (including Testing the Limits 
for Movement) 

(a.) Passive movement 

(b.) Active movement 

(c.) Aggressive movement 

(d.) Blocked movement 

(e.) Cooperative movement 

(f.) Competitive movement 

(g.) Homosexual movement 

(h.) Heterosexual movement 

(i.) Unspecified movement. 

2. Movement Responses in Female 
Figures (including Testing the Limits 
for Movement). 

Same as above. 

The reliability for the scoring was 
evaluated by having a qualified clin- 
ical psychologist classify the responses 
independently and comparing his re- 
sults with the author’s scoring. Of 
all the proposed scoring categories, 
passive movement, active movement, 
and aggressive movement occurred 
with sufficient frequency to warrant 
use. The categories of blocked move- 
ment, cooperative movement, com- 
petitive movement, homosexual move- 
ment and heterosexual movement oc- 
curred so infrequently that where pos- 
sible they were incorporated into the 
more frequent categories. There were 
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no instances where responses had to 
be scored unspecified. 


Of a total of 281 movement re- 
sponses, the scoring of the investi- 
gator and the judge concurred 275, or 
97.86 per cent of the time, yielding a 
contingency coefficient of 0.88. For 
purposes of further analysis, the in- 
stances in which scoring disagree- 
ment had occurred were resolved by 
using a third judge. He scored the 
disputed items independently and the 
two scores out of three which con- 
curred were accepted. 


The following specific predictions 
were derived from the basic hypoth- 
eses with regard to the Rorschach 
findings: 

1. The type of movement projected 
onto male and female figures by the 
paranoid and non-paranoid groups 
will differ from the type of movement 
responses given by the normal group. 

2. There will be no significant dif- 
ference between the type of move- 
ment responses given by the paranoid 
and non-paranoid groups. 


Il. Thematic Apperception Test. 
Thirteen cards were selected because 
of the variety of figures and situations 
depicted. These were: 1, 2, 3BM, 4, 
6BM, 7BM, 8BM, 10, 12M, 13MF, 
18BM, 18GF, and 20. The contents 
of the stories were organized for an- 
alysis in the following manner: 


I. Male Attitudes Toward Males 


1. Dependence-Independence Expressed 
(a.) Dependence upon male expressed 
(b.) Independence from male expressed 
(c.) Conflict over dependence-indepen- 

dence expressed 


no 


. Hostility-Aggression Expressed 
(a.) Male hostile to male 
(b.) Male aggressive to male 
(c.) Ambivalence expressed 
3. Rejection-Acceptance Expressed 
(a.) Male rejects male 
(b.) Male accepts male 
(c.) Male is indifferent to male 


ns 


. Passivity-Dominance Expressed 
(a.) Male is passive toward male 
(b.) Male is domineering toward male 
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II. Male Attitudes Toward Females 
5. Dependence-Independence Expressed: 
Same variables as I, 1. 

6. Hostility-Aggression Expressed: 
Same variables as I, 2. 

7. Rejection-Acceptance Expressed: 
Same variables as I, 3. 

8. Passivity-Dominance Expressed: 
Same variables as I, 4. 

9. Sexual Attitudes and Interests Expressed 
(a.) Guilt over heterosexuality 
(b.) Ambivalence toward heterosexuality 
(c.) Positive attitude toward heterosex- 

uality. 
III. Female Attitudes Toward Males 
10. Dependence-Independence Expressed: 
Same variables as I, 1. 

11. Hostility-Aggression Expressed: 
Same variables as I, 2. 

12. Rejection-Acceptance Expressed: 
Same variables as I, 3. 

13. Passivity-Dominance Expressed: 
Same variables as I, 4. 

14. Sexual Attitudes and Interests Ex- 
pressed: Same variables as II, 9. 

IV. Female Attitudes Toward Females 
15. Dependence-Independence Expressed: 
Same variables as I, 1. 

16. Hostility-Aggression Expressed: 
Same variables as I, 2. 

17. Rejection-Acceptance Expressed: 
Same variables as I, 3. 

18. Passivity-Dominance Expressed: 
Same variables as I, 4. 

An independent judge was used to 
test the reliability of the investigat- 
or’s scoring. Reliability coefficients 
were obtained. These are summarized 
in Table I. 


Disagreement in scoring was re- 
solved by use of a third judge as 
arbiter. 

The following specific predictions 
were made in relation to the Themat- 
ic Apperception Test findings: 

1. The behavior depicted by the 
paranoid and non-paranoid groups 
as characterizing men and women in 
the TAT stories will differ from the 
behavior described by the normal 
group. 

2. The paranoid and non-paranoid 
groups will not differ significantly in 
their portrayal of behavior of male 
and female figures in the TAT stories. 
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TABLE I—Classification of Thematic Apperception Test Responses 
by Independent Scorers 


Denendence-Independence ssa cnsn ences 
Hostility-Aggression 
Rejection-Acceptance 
PUREE PUI 5, 5 sn cncanntnsecasnnqssnicatnseee 
HOUTEN NPR ROINO nos nansncnnsnnnn seesaw 
TORRE NAAINL FUCORCAMONE Sao oncnnnnccasscnsssisosesssosens 
Attitudes Toward Self. 


RESULTs 2 


It was predicted that the paranoid 
group would differ from the normal 
group with respect to the type of 
movement projected into male and 
female figures on the Rorschach. In 
the comparisons involving movement 
in male figures (Table II, Compari- 
sons A, B, C), two determinations 
out of three were significant (P = .05 
or better). In the comparisons involv- 
ing female figures (Table II, Com- 
parisons D, E, F), none of the three 
determinations were conclusively sig- 
nificant. One comparison (Table II, 
Comparison E) was suggestive (P = 
.10-.20). 

The non-paranoid group for which 
a similar differentiation from the nor- 
mal group was predicted, did not dif- 
fer conclusively from the normal 
group in any of three comparisons in- 
volving male figures. Two determin- 
ations (Table II, Comparisons A and 
C) suggested trends toward differen- 
tiation (P — .05-.10). Of the three 
comparisons involving female figures, 
none was significant. 


It was predicted that the paranoid 
group would not differ from the non- 
paranoid group. They did not differ 
significantly on the three compari- 
sons involving male figures, and of 
the three comparisons involving fe- 
male figures, only one (Table II, 





? Tables referred to in this section have been 
deposited with the American Documentation 
Institute. Order Document No. 4880 from 
American Documentation Institute, 1719 N 
Street, N.W., Washington 6, D.C., remittin 
$1.75 for 35 mm. microfilm or $2.50 for 6x 
inch photocopies. 


351 
Per Cent 

Total Agreement Reliability 
281 97.15 0.80 
464 94.18 0.79 
231 99.13 0.81 
203 99.01 0.97 
64 92.18 0.83 
266 95.11 0.80 
234 100 1.00 


Comparison E) showed a trend (P = 
.10-.20). 

Similar predictions were made with 
regard to attitudes and behavior of 
male and female figures in the TAT 
stories of the three groups. The para- 
noid group differed significantly 
from the normal group in six out of 
fifteen comparisons (Table III, Com- 
parisons A, B, C, F, J, K) involving 
male attitudes and behavior (P = 
.05 or better). In two determinations 
(Table III, Comparisons D and E) 
the trends were suggestive (P — .05- 
.10). With regard to female response 
categories, the paranoid group dif- 
fered from the normal group in only 
two (Table IV, Comparisons A and 
B) of nine comparisons (P = .05 or 
better), whereas three determinations 
(Table IV, Comparisons D, E, H) 
showed trends (P — .05-.10). 

The non-paranoid group differed 
from the paranoid group in nine out 
of fifteen comparisons (Table III, 
Comparisons A, B, C, F, J, K, L, M, 
N) involving male response categories 
(P = .05 or better), and in one out 
of nine (Table IV, Comparison B) 
female response categories (P = 
.02-.05). 

The ema group was not differ- 
entiated from the non-paranoid group 
in any instances involving either male 
or female response categories. 


INTERPRETATION AND DISCUSSION 
OF RESULTS 


The outcome of the predictions to 
the Rorschach data indicates that the 
paranoid group does differ substan- 
tially from the normal group with 
respect to the type of movement pro- 
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jected into the male figure. The re- 
sults of the Rorschach are consistent 
with the observations of Knight (8) 
and Hinsie (5), who described the 
projection of the paranoid individual 
as a maneuver to rationalize his own 
hostility toward others. Although the 
paranoid group was not differentiat- 
ed significantly from the normal 
group in the comparison of male 
passive movement to male aggressive 
movement, the paranoid group gave 
significantly more responses of male 
passive movement and male aggres- 
sive movement, in relation to male 
active movement, than the normal 
group. Passivity and aggressiveness 
represent two aspects of the para- 
noid’s attempts to manage his hostil- 
ity. Passivity may be viewed as an at- 
tempt to deny the aggressive im- 
pulses. Because the hostility cannot 
be allayed by denial, projection oc- 
curs and others are viewed as aggres- 
sive and threatening. Fenechel (4) re- 
lated the ambivalent aggressive char- 
acteristics of the paranoid individual 
to latent homosexual impulses. This 
view was made more explicit by Brill 
(2), who regarded the paranoid reac- 
tion as a regression to an oral-anal- 
sadistic level. It is during this period 
of development, according to Brill, 
that the destructive components of the 
ego are dominant. 

The non-paranoid group, as was 
predicted, did not differ from the par- 
anoid group in comparisons of move- 
ment in male figures on the Ror- 
schach. They tended to differ from 
the normal group, but to a lesser de- 
gree than was true for the paranoid 
group. 

Although not all of the predictions 
to the Thematic Apperception Test 
involving the concept of masculine 
role were substantiated, significant 
differences between the paranoid and 
the normal group occurred, The par- 
anoid group attributed greater guilt 
and ambivalence concerning hetero- 
sexual activity than the normal group. 
In comparison to the normal group, 
the paranoid group depicted the male 
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as more dependent upon other male 
and female figures. 

The paranoid group pictured the 
male as more rejecting and indiffer- 
ent to other males than did the nor- 
mal group. The paranoid group also 
saw the male figure in conflict over 
dependence-independence, in relation 
to females, to a significantly greater 
extent than the normal group. Katz 
(6) has observed that coddling, over- 
protection, overdomination, and ig- 
noring, operating in a family struc- 
ture with a strong feminine influence, 
may act as gee factors in 
male schizophrenia. Such an atmo- 
sphere, Katz stated, contributes to 
difficulties in establishing independ- 
ence. Whitehorn (11) found yearning 
for independence to be a vital factor 
in the schizophrenic, who character- 
istically has been impeded in his at- 
tempts to develop a_ constructive 
mode of life. It is evident from the 
Thematic Apperception Test data 
that the conflict over dependence-in- 
dependence in relation to the female 
is a more potent force in the schizo- 
phrenic than is conflict in relation to 
the male. 

It is significant that the determina- 
tions involving hostile and aggressive 
attitudes and behavior on the The- 
matic Apperception Test yielded no 
significant results, whereas these vari- 
ables differentiated the paranoid 
group successfully from the normal 
group on the Rorschach. It seems that 
the latter technique, because it probes 
more deeply into the unconscious as- 
pects of personality than the The- 
matic Apperception Test, was more 
sensitive to these variables. The para- 
noid group did not differ from the 
non-paranoid group in the interpret- 
ation of the male role on the The- 
matic Apperception Test. The non- 
paranoid group, however, did differ, 
and in similar respects as was true 
for the paranoid group, from the nor- 
mal group in this regard. 

The paranoid group did not differ 
from the normal group with respect 
to the type of movement projected 
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into female figures on the Rorschach. 
On the Thematic Apperception Test, 
only the comparisons involving hetero- 
sexual activity indicated that the 
paranoid group tended to portray fe- 
males as significantly more guilty and 
ambivalent than did the normal 
group. There were minor trends to- 
ward differentiation in relation to 
females hostile to males and females 
who reject and are indifferent to 
males. This may indicate that the 
paranoid subjects permitted some of 
their unconscious hostility to male fig- 
ures to be expressec through the fe- 
male figures on the Thematic Apper- 
ception Test, rather than through male 
figures. It must be concluded, how- 
ever, that the paranoid group did not 
differ significantly from the normal 
group in the concept of the female 
role. 

None of the Rorschach or The- 
matic Apperception Test female re- 
sponse categories differentiated the 
paranoid from the _ non-paranoid 
group. The non-paranoid group did 
not differ from the normal group in 
the comparisons of female response 
categories on the Rorschach. On the 
Thematic Apperception Test, the 
only differentiating category was the 
one related to heterosexual activity. 

The considerations of concept of 
sexual role reveal that the paranoid 
and the non-paranoid groups resem- 
ble each other more significantly than 
either of the schizophrenic groups re- 
semble the normal group, but only 
with respect to the concept of the 
masculine role. The groups are not 
differentiated significantly with re- 
gard to the concept of the feminine 
role. A possible explanation for these 
results resides in the fact that an ap- 
preciation of the feminine role is 
not as vital to the adjustment of the 
male individual as is an understand- 
ing of the masculine role. The de- 
mands made upon the male individ- 
ual by society may be stated in gen- 
eral terms: he is expected to be suffi- 
ciently like other males in his be- 
havior so that his deviations are not 
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conspicuous. This requires a master- 
ing of the knowledge of what it con- 
stitutes to be a male. Serious defects 
in an individual’s concept of the male 
role may be expected to be reflected 
in difficulties in adjustment and, ulti- 
mately, in psychopathological reac- 
tions. Knowledge of the feminine role 
is achieved, for the most part, in a 
more indirect fashion by the man. It 
is not incumbent upon him to master 
the feminine role so that he can be a 
successful woman by the precepts of 
his social] milieu. 


SUMMARY 


This study compared a group of 
fifteen paranoid schizophrenics with 
a group of fifteen non-paranoid schi- 
zophrenics and a group of fifteen nor- 
mals with respect to conception of 
the masculine and feminine roles. It 
was hypothesized that the paranoid 
and non-paranoid groups would dif- 
fer significantly from the normal 
group with respect to concept of mas- 
culine and feminine roles, whereas 
the two schizophrenic groups would 
not differ in this respect. The Ror- 
schach and selected cards of the The- 
matic Apperception Test were used. 

The results indicated that the para- 
noid group differed from the normal 
group in two out of three chi square 
determinations involving Rorschach 
male response categories (P = .05 or 
better), none out of three determina- 
tions involving female Rorschach re- 
sponse categories, six out of fifteen 
chi square determinations involving 
male Thematic Apperception Test 
response categories, and two out of 
nine determinations involving female 
Thematic Apperception Test response 
categories. 

The paranoid group was not dif- 
ferentiated significantly from the non- 
paranoid group in any of the compari- 
sons. 

The non-paranoid group showed 
trends toward differing from the nor- 
mal group in two out of three deter- 
minations involving male Rorschach 
response categories (P — .05-.10), and 
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did not differ in any of the three de- 
terminations involving female Ror- 
schach response categories, They dif- 
fered significantly from the normal 
group in nine out of fifteen determin- 
ations involving male Thematic Ap- 
perception Test response categories 
and in only one out of nine determin- 
ations involving female Thematic Ap- 
perception Test response categories. 

It was concluded that the two schi- 
zophrenic groups differed from the 
normal — in their interpretation 
of the masculine role, but did not dif- 
fer in their concept of the feminine 
role. Also, the paranoid group did not 
differ from the non-paranoid group 
with respect to the concept of the 
masculine and feminine roles. Some 
theoretical implications were dis- 
cussed. 
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BOOK REVIEWS 


Fingermann, Gregorio. Fundamentos 
de Psicotecnica. Buenos Aires: El 
Ateneo, 1954. Pp. 346. 


Although the content of this book is not 
strictly appropriate for review in the Journal 
of Projective Techniques, this reviewer feels 
that in the interest of international profes- 
sional communication a brief review could 
be of some service. The author is director of 
the Instituto de Orientacion Professional del 
Museo Social Argentino (Institute of Voca- 
tional Guidance) and has published books in 
esthetics, education, philosophy, logic and 
psychology. His scope of interest appears to 
lie in the European tradition still extant in 
some American colleges in which education, 
philosophy and psychology are not entirely 
differentiated. In addition, many of the writ- 
ers quoted in this book for their contribu- 
tions in vocational psychology have also con- 
tributed in the journals to clinical and pro- 
jective psychology. 

The present volume is essentially an in- 
troduction to the problems and concepts of 
vocational guidance and employee selection 
with an emphasis on the former, though 
there is a discussion of job efficiency, job 
analysis and related topics. In the author’s 
point of view occupational and clinical psy- 
chology do not seem to be isolated topics. 
He subsumes aptitudes, skills and sensori- 
motor functioning under personality rather 
than considering them independent func- 
tions. He does not, however, present a theory 
of personality, nor does he delve extensively 
into many of the problems he touches upon. 
Largely he surveys methodologic and _ tech- 
nical considerations in macroscopic fashion. 
Personality theory is treated in terms of a 
summary of typological theories rather than 
as a dynamic concept. Nevertheless, he gives 
some attention to the use of projective meth- 
ods, particularly the Rorschach, TAT, and 
Szondi in vocational guidance and selection 
and the Miro Myokinetic Test which may 
loosely be grouped with them. Little specific 
diagnostic or prognostic information is pre- 
sented. There are virtually no experimental 
findings in either the projective or non- 
projective areas of personality measurement. 

Chapters are devoted to concepts and types 
of intelligence, aptitudes and skills, standard- 
ization, and simple statistical concepts. A few 
tests are described in detail and many more 
significant ones are not mentioned. There is 


an interesting description of organizations 
and points of view in 27 countries. Although 
there is a wide international flavor in the 
references, there is no list of references. 
While the book is less detailed and com- 
prehensive than most comparable texts in 
English, it should prove to be a useful in- 
troductory text for the groups for whom it 
was written. It is also significant in that it 
represents the very recent trend in Latin 
American countries toward writing their own 
texts in addition to translating foreign ones. 


BERTRAM R. FoRER 
Executive Editor, 
Journal of Projective Techniques 


Aliaga Lindo, Pedro. Estudio com- 
parativo de la Prueba de Rorschach 
en 238 ninos de Huachac y Lima. 
Lima: Universidad Mayor de San 
Marcos, 1955. Pp. 188. 


This monograph, the author's dissertation 
for the degree of Bachelor of Medicine, is 
a comparison by means of the Rorschach of 
the psychological development of two groups 
of Peruvian children: Huachac Indian chil- 
dren living in high mountain villages, bi- 
lingual and somewhat primitive culturally 
and the children of Lima, also of lower eco- 
nomic classes, who have been brought up in 
a cosmopolitan climate. The age range is 
from four to fifteen, grouped into four de- 
velopmental periods: four to six, seven to 
nine, ten to twelve, and thirteen to fifteen. 
Samples are small, as low as zero in some 
year-sex groups; and median ages in the sub- 
groups differ for the two cultural groups and 
for the two sexes. Hence, the developmental 
pictures are likely to be less reliable and less 
differentiated than those provided by Ames 
et al (1) and by Nunez (3). Furthermore, 
comparability of the findings to other cul- 
tural studies, even those quoted in the mono- 
graph, is somewhat dubious. 

The author points out similarities and 
differences between the sexes, between his 
Indian and Caucasoid groups, and between 
his groups and those of Ames et al, Serebrin- 
sky (Argentina), Salas (Spain), Loosli-Usteri 
(Switzerland), Endara (2) (Equador), Via 
Ortega (Peru), and several others. In this 
respect the monograph is a source of po- 
tentially useful cross-cultural information. 

Scoring of the Rorschach includes Klop- 
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fer’s classification of movement responses and 
Binder’s classification of shading. 

The monograph is well put together, clear 
in printing, chock full of lucid tables and 
graphs with summaries of the findings of 
other workers as indicated above. There are 
62 references, most of them Latin American 
and unfamiliar to North Americans, As a 
whole the monograph is well-done and at- 
tests to the growing interest in the South 
American countries in projective methods, 
particularly the Rorschach. It is most com- 
monly, however, included in the armamen- 
tarium of the psychiatrist rather than of the 
clinical psychologist. 


BERTRAM R. FORER 
VA Mental Hygiene Clinic 
Los Angeles 
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Wagner, Mazie E. and Schubert, 
Herman J. P. D.A.P. Quality Scale 
for Late Adolescents and Young 
Adults. Buffalo: State University of 
New York, College for Teachers, 1955. 

The authors present a rating scale with 

paradigms for evaluation of quality of 

human figure drawings among subjects be- 
yond childhood. Reliability measures are 
presented. 


Endara, Julio. Consideraciones 
sobre el pronostico en psiquiatria. 
Archivos de Criminologia, Neuro-psi- 
quiatria y Disciplinas conexas, 1956, 
4,3-21. (Quito) 

A discussion of prognostic cues derived 

from psychiatric observation and _ projec- 

tive research. 


Schachter, M. Sindrome depresivo 
con subconfusion y ansiedad fobico 
en un joven debiloide. Archivos de 
Criminologia, Neuro-Psiquiatria 
Disciplinas conexas., 1956, 4, 22-35. 
(Quito) 

Therapeutic and projective-diagnostic data 

in a depressive case. 


Le Gallais, Pierre. Arte e psicop- 
atias. Revista Brasileira de Saude 
Mental, 1955, 1, 121-140. (Rio) 

In an attempt to provide a theoretical ra- 

tionale for occupational therapy, the au- 

thor discusses the therapeutic and motiva- 
tional bases of artistic work. 


Campos, Francisco. Os exames de 
personalidade nos processos de sele- 
¢ao. Arquivos Brasileiros de Psicot- 
ecnica, 1955, 7, 61-69. (Rio). 

A discussion of the value of personality 

measurement and projective methods in 

vocational guidance. 


Sandoval de Andrade, Geraldo. 
Primeiras tentativas de aplicagao do 
PMK em cegos. Arquivos Brasileiros 
de Psicotecnica, 1955, 7, 89-91 (Rio). 

A pilot study of the use of Mira’s Myokin- 

etic method with the blind. 

Eysenck, H. J. La validité des tech- 
niques projectives: une introduction. 


Revue de _ Psychologie, 
1955, 5, 231-234. 
The introductory paper in a symposium 


entitled: The Validity of Projective Tech- 
niques. 


appliquée, 


Pichot, P. La validité des techniques 
projectives. Probleémes généraux. Re- 
vue de Psychologie Appliquée, 1955, 
5, 235-244. 


A general consideration of validation prob- 
lems with projective methods, followed 
by more specific considerations of Rosen- 
zweig’s Picture Frustration and the Szondi 
tests. 


Cronbach, L, J. Les exigences de la 
validation des techniques projectives. 
Revue de Psychologie Appliquée, 
1955, 5, 245-254. 

A critique of traditional conception of val- 

idity and validation with recommenda- 

tions for more appropriate methods of 
dissecting the prediction situation and 
measuring validity. 


Payne, R. W. L’Utilité du Test de 
Rorschach en psychologie clinique. 
Revue de Psychologie Appliquée, 
1955, 5, 255-264. 

The author marshalls evidence to demon- 

strate the impracticability of clinical use 

of the Rorschach without an underlying 
theory more adequate than current ones. 


Van Lennep, D. J. and Houwink, 
R. H. La validation du Test-Des- 
Quatres-Images. Revue de Psychologie 
Appliquée, 1955, 5, 265-282. 

Validation data and a factor analysis of 

the Four-Picture Test. 


Mullener, Eduard. Rorschachbe- 
funde bei Farbenblindheit. Zeitschr. 
f. diagnost. Psychol. u. Persénlichkeits- 
forsch., 1956, 4, 3-23. 

Rorschach protocols of 52 red-green blind 

subjects are discussed. 


Hiltmann, Hildegard. Psychol- 
ogische Begutachtung der Glaub- 
wirdigkeit jugendlicher Zeugen, spe- 
ziell bei Sittlichkeitsdelikten. Zeitschr 
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f. diagnost. Psychol. u. Persénlich- 
keitsforsch., 1956, 4, 24-25. 
Psychologic problems underlying the re- 
liability of children’s legal testimony. 


Rasch, Wolf-Dietrich. Ein neues 
Beurteilungsschema zur Bewarungs- 
kontrolle grophologischer Eignungs- 
gutachten. Zeitschr. f. diagnost. Psy- 
chol. u. Persénlichkeitsforsch., 1955, 
4, 45-59. 

A discussion of the methodology of vali- 

dation of graphologic techniques including 

a new questionnaire, 


Wewetzer, Karl-Hermann and 
Freudenberg, Dorothea. Uber Verlauf 
und Erfolg einer Spielgruppenthera- 
pie. Zeitschr. f. diagnost. Psychol. u. 
Persénlichkeitsforsch., 1956, 4, 59-82. 


A description of process and changes in 
a child’s play group in terms of group 
structure and projective methods. 


Friedemann, A. Inequalities in the 
reproduction of the plates for the Ror- 
schach form interpretation experi- 
ment. Zeitschr. f. diagnost. Psychol. u. 
Persénlichkeitsforsch., 1956, 4, 104- 
107 (Rorschachiana), 

A description of differences in color be- 

tween the original Rorschach plates and 

later reproductions. 





General Newsletter 


Huber, Hans Jr. Uber die Qualitat 
der Rorschach-Tafeln. Zeitschr. f. 
diagnost. Psychol. u, Persénlichkeits- 
forsch., 1956, 4, 110-115. (Rorschach- 
iana). 

A defense of current Rorschach plate 

reproductions against Friedemann’s criti- 

cisms. 

(See previous paper.) 

Missaglia, Antonello. Osservazioni 
sull’indagine dell’inconscio mediante 
il Test di Rorschach. Annali Neuro- 
psichiatria e Psicoanalisi, 1955, 2, 223- 
231. (Napoli). 

Examination of the applicability of Freu- 

dian concepts to interpretation of Ror- 

schach content. 


Missaglia, A. Osservazioni psicopat- 
ologiche su un caso di tumore della 
fossa cranica anteriore. Giornale di 
Psichiatria e di Neuropatologia, 1955, 
4, 1-16. (Ferrara) 

Preoperative and postoperative Rorschach 

and Behn-Rorschach data are presented on 

a case of brain tumor. 


Missaglia, Antonello. Gli “Arche- 
tipi” dal Test di Rorschach. Giornale 
di Psichiatria e di Neuropatologia, 
1956, 5, 1-43. (Ferrara) 

Demonstration of archetypal indications 

in 10 Rorschach protocols. 
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Society for Projective Techniques 


The program of the annual convention of the American Psychological 
Association has been announced. The Society for Projective Techniques por- 
tion of this program reads as follows: 


Friday, August 31 — 3:50-4:50 — Business Meeting, Room 107, Hotel Sherman 
Friday, August 31 — 7:30-9:30 — Symposium, Assembly Room, Hotel Sherman 
(The Adjustment of the Overt Male Homosexual) 
(Klopfer, Ellis, Hooker, Frenkel-Brunswik) 
Saturday, Sept. 1— 7:00-10:00—Dinner and Presidential Address, Crystal 
Room, Hotel Sherman 
(Jules D. Holzberg. The Clinical and Scientific Meth- 
ods: Synthesis or Antithesis?) 
Monday, Sept. 3 — 3:50-5:50 — Symposium, Assembly Room, Hotel Sherman 


(Validity Aspects of Multiple Projective Techniques 
in Child Research) 


(Stone, Murphy, Kass, Heidér, Bolgar) 
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